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ABSTRACT 


This  thesis  describes  the  development  and  application 
of  quas  i  1  i  nea r i zat ion  and  linear  programming  techniques 
to  the  solution  of  problems  associated  with  the  adjustment 
of  process  data,  estimation  of  parameters  in  process 
models,  and  the  design  of  optimal  state  driving  control 
systems.  Experimental  data  from  a  computer  controlled 
pilot  plant  evaporator  are  used  to  demonstrate  the 
practicality  and  potential  industrial  importance  of  each 
app 1  i  cat  ion  . 

A  data  analysis  program,  which  is  independent  of 
the  appl  icat  ion,’  performs  the  data  acquisition,  filtering, 
statistical  analysis  and  data  adjustment.  The  program 
was  used  routinely  to  produce  a  consistent  set  of 
evaporator  data  for  later  analysis. 

An  extensive  literature  review  and  comparison  of  pro¬ 
cess  identification  and  parameter  estimation  techniques 
and  their  applications  is  presented  as  a  guideline  for 
choosing  a  suitable  method  for  a  specific  application. 

The  literature  review  and  previous  work  showed  that 
quas  i  1  inear  izat  ion  was  a  powerful  method  for  handling  the 
parameter  estimation  problem.  Quas  i  1  inear  i. zat  ion  was  com¬ 
bined  with  linear  programming  to  produce  a  generalized 
parameter  estimation  computer  program  which  had  adequate 
flexibility  to  be  able  to  incorporate  a  priori  knowledge  and 


constraints  of  the  process  which  is  being  identified. 

A  convenient  constrained  parameter  perturbation  tech¬ 
nique  was  developed  which  increased  the  region  of  conver¬ 
gence  of  the  parameter  estimation  algorithm. 

Linear  programming  techniques  were  used  alone  to 
solve  the  dynamic  optimization  associated  with  the  calcula¬ 
tion  of  the  optimal  control  strategy.  A  standard  state- 
space  model  and  a  linear  performance  index  was  employed. 

Quas i  1  inear  izat  ion  and  linear  p rog ramm ing  were  used  for  the 
identification  of  process  models.  Experimental  and  simu¬ 
lated  results  from  a  pilot  plant  evaporator  indicate  improved 
performance  over  conventional  feedback  control  for  set 
po  i nt  changes . 

Optimal  control  proved  to  be  sensitive  to  model 
accuracy.  A  fifth  order  theoretical  linear  model  which 
agreed  reasonably  well  with  the  open  loop  process  response 
was  rot  satisfactory  for  determining  optimal  control  policies. 
Fitted  models  performed  better.  Policies  based  on  a  reduced 
model  were  satisfactory  if  the  switch  times  were  tuned  ex¬ 
perimentally  but  constraints  could  not  be  incorporated. 

A  new  approach  for  adding  optimal  state  driving  control 
policies  to  conventional  multiloop  or  optimal  multivariable 
feedback  control  systems  is  demonstrated  to  be  simple  and 
convenient.  The  simpler  open-loop  process  model. can  be  used 
for  the  calculations  and  "automatic"  transfer  to  regulatory 
control  facilitates  implementation. 


For  more  difficult  applications  such  as  plant  startup 
subopt  imal  control  policies  are  calculated  using  nonlinear 
process  models  by  formulating  the  problem  as  one  of  iden¬ 
tifying  parameters  in  an  assumed  control  law.  This 
approach  gives  the  designer  more  flexibility  by  permitting 
for  examp le,  a  reduction  in  the  number  of  switching  times 
to  simplify  implementation. 

The  listings  of  the  FORTRAN  programs  used  in  this 
work  and  some  user  oriented  documentation  were  reproduced 
and  bound  separately  from  the  thesis. 

Use  of  all  the  developed  procedures  and  programs  on 
realistic  engineering  problems  indicated  that  they  are 
practical  and  should  be  of  use  in  industrial  applications. 
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CHAPTER  ONE 


INTRODUCT ION 


The  motivation,  scope  and  status  of  the  work  presented 
is  outlined  so  as  to  maintain  continuity  throughout  the 
thesis.  The  thesis  format  which  consists  of  several 
relatively  independent  chapters  is  revealed  for  clarity. 
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1  *  GENERAL 

The  Data  Acquisition,  Control  and  Simulation  Center  in  the 
Department  of  Chemical  and  Petroleum  Engineering  at  the  Univ¬ 
ersity  of  Alberta  houses  an  IBM  1800  process  control  computer 
which  has  the  capability  of  data  acquisition,  data  reduction, 
direct  digital  control  (DDC)  and  programmed  control.  Since 
the  spring  of  1968  the  control  computer  has  been  interfaced 
to  several  pilot-plant  sized  processes  and  a  series  of  com¬ 
puter  control  studies  have  been  implemented.  Studies  involving 
feed  forward  and  multi  loop  feedback  control  schemes  on  an 
evaporator  [1,2]  and  a  distillation  column  [3,4,5]  were  imple¬ 
mented  and  demonstrated  several  advantages  over  conventional 
single  variable  feedback  control  schemes.  More  recently 
mu  1 1  i  va r  iab 1 e  computer  control  has  led  to  investigations  of 
optimal  regulatory  control  designed  using  dynamic  programming 
[6].  Development  of  an  on-line  program  [7]  for  efficient 
automatic  startup  is  near  completion. 

This  work  at  the  University  of  Alberta,  and  elsewhere, 
has  been  paralled  by  growing  industrial  acceptance  of  computer 
control  [8]  and  installation  of  real-time  digital  computers 
which  have  the  capability  of  implementing  multivariable  control 
systems.  Also  a  great  deal  of  theoretical  work  in  the  area 
of  optimal  mu  1 1  i  va r i ab 1 e  control  theory  has  been  completed  in 
recent  years  and  great  potential  for  improved  control  is  evident. 
Design  of  optimal  multivariable  control  systems  employs  the 


I 
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state  representation  and  modern  dynamic  optimization 
techniques. 

2 .  SCOPE  OF  THIS  WORK 

The  previous  work  indicated  a  need  for  a  general 

parameter  estimation  procedure  for  the  identification  of 
process  models  and  an  optimal  multivariable  control  system 
to  augment  feedback  control  for-  setpoint  changes  or 

state  driving  applications.  This  work  is  concerned  with 
the  application  of  quas  i  1  i  nea r  i  zat  ion  and  linear  programming 
techniques  to  the  design  of  a  servomechanism  control 
system.  Experimental  testing  and  evaluation  is  performed 
on  a  pilot  plant  evaporator  equipped  with  conventional  in- 
s t rument at  ion .  Emphasis  is  placed  on  the  practical  details 
of  implementation  and  operation  as  well  as  the  theory. 

The  overall  design  of  the  optimal  state  driving  control 
system  involves  several  steps: 

1.  computer acqu is i t ion  and  adjustment  of  data  for  use 
in  characterizing  the  process  and  defining  the 
control  problem. 

2.  modelling  and  identification  of  the  process. 

3-.  dynamic  optimization  based  on  a  process  model. 

4.  implementation  of  an  optimal  state  driving  control 
po 1  icy. 

The  following  subsections  out  1  ine  the  work  performed  in  each 


of  these  areas: 


' 

. 
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2 . 1  Data  Acquisition  and  Adjustment 

Before  i  den t i f i cat  ion ,  simulation  or  control  analysis  is 
performed,  it  is  desirable  to  have  a  consistent  set  of  data 
which  satisfies  physical  constraints  such  as  the  process 
material  and  energy  balances.  A  generalized  program  is 
described  in  reference  [9]  which  performs  on-line  data 
acquisition,  calculation  of  errors  of  closure  in  the  steady 
state  mass  and  energy  balances,  statistical  testing  for 
consistency  of  the  data  and  adjustment  of  the  data  to  provide 
a  consistent  set  of  data.  This  program  is  executed  as  a 
standard  step  in  the  data  processing  procedure  for  each 
experimental  run  performed  on  the  evaporator.  Linear 
programming  was  used  as  a  method  for  the  adjustment  of  the 
raw  process  data. 

2 . 2  Process  Parameter  Estimation 

A  general  parameter  estimation  algorithm  was  developed 
since  the  need  existed,  not  only  for  the  reduction  of  process 
data  in  control  applications,  but  also  in  other  areas  such  as 
in  the  analysis  of  kinetic  data.  Quas  i  1  inear  izat  ion  combined 
with  linear  programming  was  chosen  for  two  main  reasons: 

1.  Donnelly  [10]  had  previously  worked  with  quasi- 
linearization  as  a  numerical  method. 

2.  an  extensive  search  of  the  literature  indicated 
this  approach  to  be  general  and  powerful. 

The  quas  i  1  inear  izat ion  plus  linear  programming  algorithm 
was  used  to  fit  parameters  in  control  models,  for  use  in 
state  driving  control  applications. 


. 

. 
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2 . 3  Optimal  State  Driving 

Often  in  industrial  processes  it  is  required  to  change 
operating  conditions.  The  optimal  control  problem  is  to 
accomplish  this  transition  while  minimizing  a  performance 
index  (eg.  minimum  time).  A  standard  linear  programming 
system  wa s  used  for  the  dynamic  optimization  of  the  multi- 
variable  model  response  because  it  is  commonly  used  in 
industry  and  it  enables  a  priori  knowledge  and  constraints 
to  be  incorporated  into  the  problem  solution.  The  optimal 
control  strategy  is  produced  as  a  discrete  time  series  which 
can  be  conveniently  introduced  into  a  DDC  control  scheme. 

For  more  difficult  applications  such  as  plant  startup 
it  is  advisable  to  work  with  the  nonlinear  model.  A  tech¬ 
nique  is  presented  in  which  the  functional  form  of  the  control 
law  is  assumed  and  the  parameters  are  optimized.  This 
approach  gives  the  designer  a  certain  degree  of  flexibility 
which  does  not  exist  in  true  optimal  control  techniques. 

Such  a  design  approach  is  applicable  to  conventional  PID 
control,  " subopt  ima 1"  control  laws  and  optimal  control  laws 
for  certain  classes  of  problems. 

3  •  STATUS  OF  WORK 

In  chapter  seven  a  discussion  of  the  implementation, 
extensions  and  industrial  uses  of  these  techniques  indicates 
that  this  work  serves  as  a  starting  point  for  industrial 
application  of  the  techniques  studied  in  previous  chapters. 


•! 
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4.  THESIS  FORMAT 

Chapters  two  through  six  are  written  in  a  format 
comparable  to  that  used  by  most  technical  journals  with  the 
objective  of  providing  a  concise  and  complete  presentation. 
Each  chapter  is  relatively  independent  of  others  and  can  be 
conveniently  accessed  by  a  reader  interested  in  only  cer¬ 
tain  aspects  of  the  thesis  but  this  necessitated  some 
duplication  of  material. 

The  thesis  is  supplemented  by  manuals  containing  de¬ 
tailed  documentation  of  the  computer  programs  and  algorithms. 
These  manuals  have  been  bound  separately  for  convenience 
since  they  are  not  necessary  to  this  presentation  of 
research  results  and  are  on  file  in  the  Department  of  Chemical 
and  Petroleum  Engineering. 
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CHAPTER  TWO 

A  REVIEW  OF  PROCESS  IDENTIFICATION  AND 
PARAMETER  ESTIMATION  TECHNIQUES 


ABSTRACT 

A  survey  of  the  recent  1  iterature  in  the  area  of  pro¬ 
cess  identification  and  parameter  estimation  techniques 
applicable  to  lumped-parameter,  determ  in  ist  ic,  dynamical 
systems  is  presented.  Methods  reviewed  include  statistical 
estimation  techniques,  direct  and  indirect  methods  based 
on  optimal  control  theory,  functional  expansion,  impulse 
response,  frequency  response  and  a  number  of  other 
specific  methods.  Each  method  Is  presented  in  a  consistent 
format  which  includes  an  outline  of  the  general  character¬ 
istics,  ca 1 cu 1  at  iona 1  techniques,  experimental  techniques, 
reliability  estimates  and  app 1  i cat  ions .  The  overall 
objective  is  to  provide  a  basis  for  comparison  of  the 
methods  and  a  guide  to  particular  applications  which  will 
assist  the  reader  in  selecting  the  best  method  for  his 
spec  i  f  i  c  p  rob  1 em . 
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1  .  INTRODUCT ION 

Mathematical  models  which  adequately  characterize  the 
dynamic  performance  of  physical  systems  are  essential  for 
most  modern  control  analysis,  optimization  and  design  methods. 
In  some  instances  there  is  no  a  priori  information  about 
the  system  and  the  topology  of  the  model  must  be  determined 
from  experimental  tests  or  defined  by  assuming  some 
empirical  form.  in  other  cases  the  functional  form  of 
the  model  and  perhaps  some  of  the  parameters,  are  known 
from  theoretical  analysis  or  previous  tests.  However,  in 
almost  all  cases  complete  specification  of  the  model  requires 
estimation  of  unknown  parameters  of  the  model,  based  on 
experimental  data.  Many  techniques  are  applicable  to  these 
process  identification  and  parameter  estimation  problems, 
but  each  is  limited  to  problems  with  specific  character  ist  ics 
or  by  the  experimental  techniques  or  data  that  are  required. 

At  the  1967  I.F.A.C.  Symposium  on  "Process  Identification 
in  Automatic  Control  Systems"  in  Prague,  sixty-five  papers 
were  presented.  Godfrey  and  Hammond  [1]  summarize  some  of 
the  main  topics  of  discussion  at  this  meeting  and  conclude 
that  although  there  are  many  techniques  available  there  seems 
to  be  no  logical  basis  for  choosing  between  them  and  that 
there  are  relatively  few  applications  which  have  been  pre¬ 
sented  in  the  literature.  This  paper  was  written  with  the 
hope  of  contributing  to  the  solution  of  this  dilemma.  How¬ 
ever,  in  order  to  keep  this  presentation  to  a  reasonable 
size  the  author  has: 


' 
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(1)  restricted  it  to  lump-parameter,  deterministic, 
dynamical  systems  and  specifically  omitted 
distributed  parameter  systems  [2,3^4],  stochastic 
systems  and  most  of  the  techniques  that  are 
suitable  for  only  steady-state  (algebraic) 
systems ; 

(2)  referred  extensively  to  existing  papers  or 
texts  for  definitive  and/or  detailed  discussion; 

(3)  concentrated  on  recent  literature  and  omitted 
most  of  the  material  included  in  previous 
surveys,  in  the  bibliography  of  major  refer¬ 
enced  papers  or  which  dealt  with  material 
which  was  judged  to  be  adequately  covered  by 
other  references  quoted  herein;  and 

(4)  relied,  in  many  cases,  on  the  title  and  the 
data  included  in  the  list  of  references  to 
define  the  particular  subject  area  and  the 
chronological  order  of  the  various  works. 

The  primary  organization  of  this  paper  is  based  on 
the  following  c 1  as s i f i cat  ion  of  the  problems  to  which  tech¬ 
niques  can  be  applied  to  estimate: 

(a)  Parameters  in  ordinary  differential  equations; 

(b)  Parameters  in  an  analytical  solution: 

(c)  Parameters  in  a  discrete  model: 

( d)  Coefficients  in  a  functional  series  expansion; 

(e)  Impulse  response; 

(f)  Frequency  response. 
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A  secondary  division  is  based  on  the  specific  esti¬ 
mation  techniques  which  apply  to  each  classification  of 
problem.  Some  of  the  divisions  may  appear  arbitrary  but 
the  criterion  used  for  creating  a  specific  problem  classi¬ 
fication  or  divison  between  estimation  techniques  was 
whether  there  was  a  significant  amount  of  literature 
dealing  with  the  subdivision  and/or  whether  in  the  author's 
opinion  it  improved  the  clarity  of  the  presentation.  It 
will  be  noted  that  the  first  column  of  Table  1  is  a  list 
of  the  problem  classifications  plus  the  applicable 
estimation  techniques.  The  balance  of  Table  1  represents 
a  summary  and  a  comparison  of  the  main  features  of  each 
estimation  technique.  (The  terminology  is  defined  in 
Sect  ion  1.1). 

Each  estimation  technique  is  discussed  further  in  the 
sections  of  this  report  bearing  the  same  number  as  used 
in  Table  1  and  includes  subsections  dealing  with: 

(a)  General  discussion; 

(b)  Computational  techniques  and  reliability 
es t  imates ; 

(c)  Experimental  techniques; 

( d)  App 1  i cat  ions . 

The  balance  of  this  introduction  is  devoted  to  a  summary  of 
the  principal  characteristics  of  estimation  techniques,  a 
discussion  of  the  reliability  of  parameter  estimates  and 
a  brief  review  of  some  of  the  basic  statistical  estimation 
methods  which  are  used  extensively  in  parameter  estimation. 


' 


■ • ^  Principal  Characteristics  of  Estimation  lechniques 


Process  identification  and  parameter  estimation  tech¬ 
niques  differ  significantly  with  respect  to  the  type  of 
model  to  which  they  can  be  applied,  the  criterion  selected, 
the  calculation  techniques  that  must  be  used,  the  test 
signal  that  is  used  to  perturb  the  system,  and  the  type  and 
amount  of  experimental  data  that  are  required  or  can  be 
handled.  There  are  many  excellent  review  articles  which 
survey  the  literature  and  discuss  these  general  character¬ 
istics.  A  paper  by  Cuenod  and  Sage  [5]  presented  at  the 
1967  I.F.A.C.  Symposium  reviews  many  of  the  current  methods 
and  illustrates  them  with  simplified  examples.  Eykhoff,  in 
a  paper  presented  at  the  same  meeting  [6]  and  in  an  earl ier 
article  [7],  takes  a  different  approach  towards  d'iscussion 
of  many  of  the  same  methods.  Balakrishnan  and  Peterka  [8] 
classify  identification  methods  with  respect  to  criterion 
of  optimality,  the  mathematical  model  used,  the  computing 
technique  and  the  input  signal.  Characterization  of  non¬ 
linear  systems  is  considered  by  Harris  and  Lapidus  [9]  and 
A 1 eksandrovsk i i  and  Deich  [10]  .  More  recent  review 
articles  which  are  cited  later  in  this  paper  and  are  recom¬ 
mended  to  the  reader  seeking  a  broader  perspective  include 
those  by  Bard  and  Lapidus  [11],  Seinfeld  [12]  and  Young 
[13,14].  The  proceedings  of  the  1970  I.F.A.C.  Symposium 
on  "Process  Identification  and  Parameter  Estimation",  held 
in  Prague,  also  include  an  excellent  review  article  by 
Astrom  and  Eykhoff  [15]  and  many  pertinent  papers. 
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The  characteristics  used  in  this  paper  as  a  basis 
for  comparing  identification  and  estimation  techniques  are 
defined  in  the  following  subsections  and  also  comprise 
the  column  headings  in  Table  1. 

(a)  A_Qr  jo  restructure 

Following  the  general  approach  taken  by  Harris  and 
Lapidus  [9]  and  Eykhoff  [16]  the  amount  of  information 
available  about  the  structural  conf  i  gu rat  ion ,  or  functional 
form,  of  the  model  can  be  classified  as  none,  partial  or 
comp  1 et e 

(  i)  No  available  information  -  in  this  case,  the 
topology  or  structural  configuration  of  the 
"black  box"  process  must  be  determined  in  addi¬ 
tion  to  generating  numeric  estimates  of  specific 
parameters  [5,16,17].  'Process  identification1 
usually  refers  to  the  experimental  determination 
or  approximation  of  the  system  topology. 
'Parameter  estimation'  deals  with  generating 
numeric  estimates  of  specific  parameters  or 
coefficients  in  the  system  model  and  usually 
follows  any  process  identification  procedure  [9]. 
Some  procedures  consist  of  a  series  of  parameter 
estimation  problems  using  different  assumed 
models  [18]  followed  by  model  d i scr  im inat ion 
procedures  to  select  the  'best'  model  [15]. 

(ii)  Partial  information  available  -  information  about 
the  structural  configuration  of  the  model  plus 
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Classification  of  Current  Methods  of  Identification 
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estimates  or  limits  on  some  of  the  parameters 
can  frequently  be  used  to  select  a  suitable 
functional  form  for  the  model  and/or  simplify 
the  identification  and  parameter  estimation 
problem.  A  chemical  reaction  system  in  which 
only  part  of  the  reaction  mechanism  is  known 
typifies  this  definition.  In  some  applications 
a  prior?  information  is  used  only  to  generate 
the  starting  point  and/or  to  constrain  parameters 
and  promote  convergence  of  the  numerical  calcula¬ 
tions  associated  with  the  selected  estimation 
techn  i que . 

(iii)  Complete  information  available  -  by  definition, 
the  process  identification  step  is  complete  and 
all  that  remains  is  the  parameter  estimation 
problem.  A  reaction  system  described  by  an 
assumed  mechanistic,  kinetic  model  but  with  un¬ 
known  rate  constants  falls  into  this  category. 

(b)  State_L  mear  i_ty 

Although  most  physical  problems  are  non-linear,  a 
linearized  model  is  often  used  to  approximate  the  system 
response  because  of  the  simpler  form  of  the  model,  the 
resulting  simplification  of  the  parameter  estimation  and 
the  wider  range  of  control  theory  that  has  been  developed 
for  1  inear  systems.  When  the  model  is  to  be  used  to  predict 
system  behaviour  about  some  nominal  set  of  values,  such  as 
normal  p 1  an t -ope r at i ng  conditions,  then  the  1  inear  model 
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is  frequently  adequate.  It  can,  however,  give  misleading 
informat  ion-  about  system  stability,  the  global  optimum  and 
even  steady-state  responses. 

A  non-linear  system  can  be  represented  in  the  following 
mathematical  form: 


X  =  f[x(t) ,  u(t) ,  £(t)] 


(1) 


X(t) 


h[x(  t)  ,  u(  t)  ]  +  v(  t) 


(2) 


where 

x(t)  »  state  vector  (n  x  1), 

jj(t)  =  input  or  control  vector  (m  x  1) 

(corrupted  by  noise  in  general), 

£(t)  =  unknown  parameters  vector  (p  x  1), 

_y_(t)  =  output  vector  (r  x  1), 

jv  ( t )  =  measurement  noise  (r  x  1). 

The  parameter  estimation  problem  is  to  determine  jg(t)  such 
that  the  model  'best  fits'  the  given  experimental  data, 

_y_(t),  according  to  an  assumed  criterion.  Usually  the  experi¬ 
mental  data  are  a  series  of  discrete  values  of  the  output 
variables  at  various  values  of  the  independent  variable  for 
a  known  or  measured  perturbation  in  the  input  vector  _u. 

In  some  cases  the  order  of  the  model,  n,  is-  unknown  [19]. 

Also  techniques  are  available  for  reducing  mathematical  models 
to  their  "minimal  parametric  rep  resent  at  ion"  [15*20-22]. 
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For  the  special  case  of  linear  systems  equations  (1) 
and  (2)  reduce  to: 

x(t)  =  A(t)  x(t)  +  B(t)  u(t)  (3) 

X(t)  =  C(t)  x(t)  +  v(t)  (4) 

where  the  unknown  parameters  appear  in  _A ( t )  and/or  J3(t). 

The  most  important  characteristic  of  the  analysis  of 
linear  systems  is  the  applicability  of  the  principle  of 
superposition.  The  process  identification  problem  is  again 
stated  in  a  similar  fashion. 

T ime- invar iant  systems  are  an  important  sub-class  of 
1  inear  systems  and  can  be  represented  by: 

x(t)  =  Ax(t)  +  Bjj(t)  (5) 

X(t)  =  Cx(t)  +  v(t)  (6) 

where  the  unknown  parameters  are  constants  which  appear  in 
the  matrices  A_  and/or  B_.  It  must  be  emphasized  that  the 
linearity  referred  to  in  this  section  is  with  respect  to  the 
state  variables  and  not  with  respect  to  the  parameters.  Even 
a  linear  t  ime- i nva r i ant  system  such  as  one  represented  by 
equation  (5)  results  in  a  non-linear  parameter  estimation 
problem.  This  follows  from  the  fact  that  most  techniques 
for  estimating  parameters  in  a  differential  equation  act¬ 
ually  integrate  the  equations  and  then  estimate  the  para¬ 
meters  in  the  resulting  algebraic  expressions  x(t).  For 
example,  the  solution  to  (5),  assuming  zero  initial  condi- 


17 


t ions  and  a  disturbance  introduced  at  time  zero,  can  be 
w r  i t ten  [22 ]  as : 


(7) 


o 


where 


£(t  -  ?)  =  exp  [A(t  -  5)  ] 


When  unknown  parameters  occur  in  the  A  matrix  the  estima¬ 
tion  problem  is  obviously  non-linear. 

(c) 

Some  techniques  will  handle  Multiple  Input,  Multiple 
Output  (M1M0)  systems  while  others  are  restricted  to  Single 
Input,  Single  Output  (SISO)  analysis.  A  further  restriction 
arises  because  some  techniques  are  only  practical  for 
low-order  systems.  A  set  of  SISO  systems  may  be  used  to 
model  a  MIMO  system,  for  example,  a  matrix  of  transfer 
funct  ions. 

( d)  21scb®te/cont jnuous 

The  mathematical  models  defined  by  equations  (1)  to 
(6)  are  continuous  but  can  also  be  formulated  in  discrete 
form  and  most  estimation  techniques  can  be  formulated  to 
handle  either  case  (reference  section  4.0).  It  is  important 
to  note  that  for  practical  appl  ications  many  of  the  mathe¬ 
matical  operations  involved  in  the  1 cont  inuous '  formulations 
are  approximated  by  numerical  methods.  (The  most  common 
example  is  integration).  Thus,  in  many  cases,  even  the 
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'continuous'  techniques  are  implemented  using  numerical 
techniques  and  time  series  of  discrete  data. 

(e)  P  a  r^ame  t  e  r  s  _Con  s  t  a  n  t /Varying 

In  some  model  formulations  such  as  equations  (1)  to 
(4)  the  parameters  are  assumed  to  be  functions  of  time  while 
in  others,  for  example  equations  (5)  and  (6),  they  are 
assumed  to  be  time  invariant  or  constant.  It  should  be 
noted  that  most  methods  that  handle  time-variant  systems 
will  also  handle  t ime- invar iant  problems,  but  the  calcula- 
t ional  effort  (computer  time)  is  often  significantly 
greater  than  techniques  designed  to  deal  specifically  with 
t ime- i nva r iant  systems.  In  general,  a  linear  model  with 
time-varying  parameters  will  more  accurately  approximate 
a  non-linear  system  than  a  linear  model  with  constant 
coef  f i c i en t s  . 

(f)  Handl_e_T_ime_De]_ays 

The  pure  time  delay  (transport  lag)  is  a  feature  of 
many  physical  systems,  particularly  in  the  process  indust¬ 
ries,  and  must  be  incorporated  into  the  model.  In  these 
situations  the  ability  to  estimate  the  time  delays  without 
significantly  complicating  the  analysis  will  be  an  impor¬ 
tant  factor  in  selecting  the  est  imat  ion  technique  [23]* 

(9)  Constraints 

In  most  systems  the  actual  values  of  at  least  some  of 
the  parameters  are  constrained  by  physical  limits  or  con¬ 
servation  laws.  For  example,  many  parameters  cannot  be 
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negative.  Estimation  techniques  vary  tremendously  in 
their  ability  to  include  constraints. 

For  those  methods  (e.g.  Kalman  filtering)  which  gen¬ 
erate  estimates  of  the  state  vector,  x,  coincident  with 
the  estimate  of  the  parameters,  then  constraints  on  the 
states  might  also  be  considered. 

(h)  S  j_gna  l_Degen  den  t 

In  some  cases  the  choice  of  the  estimation  technique 
defines  the  input  or  forcing  function  that  must  be  used 
to  excite  the  system.  For  example,  classical  frequency 
response  analysis  necessitates  the  use  of  pure  sinusoidal 
variations  in  the  forcing  variable.  In  some  cases,  it  may 
not  be  practical  or  convenient  to  generate  the  requ \  red 
signal  and  hence  techniques  can  be  rejected  on  this  basis. 
In  general,  the  techniques  with  the  fewest  restrictions 
on  choice  of  the  forcing  function  have  the  most  sophis¬ 
ticated  dat a-p rocess i ng  (highest  computer  time)  require¬ 
ments.  Frequently  even  the  general  methods  that  are 
'signal  independent'  can  be  simplified  by  proper  choice  of 
the  forcing  function.  The  choice  of  test  signal  also  in¬ 
fluences  the  accuracy  and/or  precision  of  the  parameter 
estimates  and  the  total  experimental  time  or  amount  of  data 
required.  Several  papers  discuss  the  selection  of  test  a 
s  igna 1  [24-30]  . 
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The  broader  question  of  experimental  design  to 
eliminate  factors  such  as  bias  produced  by  different 
process  operators,  aliasing  of  some  effects  by  others, 
unnecessary  replicates,  etc.  are  as  important  in  the  area 
of  parameter  estimation  as  in  any  other  experimental 
study.  Texts  exist  in  this  area  [31]  and  many  publications 
deal  with  the  'sequential'  (vs.  a  priori)  approach  to  ex¬ 
perimental  design  [11,32,33]  and  techniques  for  relating 
the  experiments  to  the  assumed  model  [34]. 

(i)  Sens  _[t  i_v]_ty_to_D_[s  t  u  rbances 

In  practical  applications  the  test  signals  are  often 
corrupted  by  noise  or  confounded  with  uncontrolled  distur¬ 
bances  which  enter  the  system.  Some  estimate  of  the 
sensitivity  of  the  estimation  methods  to  disturbances  is 
given  in  column  (i)  of  Table  1.  Obviously  the  methods 
that  are  signal  dependent  cannot  tolerate  large  random 
disturbances.  In  other  methods  the  random  disturbances, 
if  they  can  be  measured,  can  frequently  be  handled  as 
known  inputs.  Some  techniques  are  more  tolerant  of  noise 
than  others  but,  in  general  a  decrease  in  the  signal- 
to-noise  ratio  decreases  the  reliability  of  the  parameter 
estimates.  In  extreme  cases  stochastic  methods  must  be 
used  but  these  are  not  dealt  with  in  this  paper. 

(j)  A  H_S  tates_Access  _[bl_e 

Some  methods  can  be  used  with  measurements  of  only 
some  of  the  output  variables,  y_;  others  require  measurements 
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for  all  output  variables;  other  more  restrictive  methods 
require  measurements  or  1 obse rvab i 1 i ty 1  of  all  of  the 
state  variables,  x ,  and  some  require  the  time  derivative 
of  the  state,  x.  "Observers"  or  filters  can  be  used  to 
generate  x  or  x  [35]  but  only  the  "completely  controllable 
and  observable"  part  of  the  model  can  be  determined  from 
input-output  measurements  [15,22]. 

(k)  Qata_P  rocess  j_ng 

With  some  estimation  techniques  all  the  data  must  be 
collected  before  data  analysis  begins  and  a  single  estimate 
of  the  parameters  is  produced.  In  computer  terms  this  is 
normally  an  off-line,  batch  job.  Other  techniques,  usually 
referred  to  as  'sequential1,  can  be  executed  in  'real-time' 
and  use  the  data  obtained  at  each  time  interval  to  produce 
an  updated  estimate  of  the  parameters. 

(fi)  Qata_Sets 

Some  estimation  techniques  will  accept  only  a  single 
set  of  data  (replicates  can  be  averaged  and  used).  The 
more  powerful  techniques  will  handle  multiple  data  sets 
even  if  they  are  taken  under  different  (known)  conditions. 
Multiple  data  sets  are  represented  in  this  paper  by  sub¬ 
scripted  vectors,  . 

1 .2  Reliability  Estimates 

Reliability  estimates  of  the  parameters  should  be  an 
integral  part  of  every  parameter  estimation  problem.  They 
not  only  indicate  the  degree  of  confidence  that  should  be 
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placed  on  the  results  but  can  also  play  an  important  role 
in  maximizing  the  information  gained  from  subsequent 
experiments  [11].  For  this  reason  a  discussion  of 
reliability  estimates  is  included  in  most  of  the  following 
sections.  However,  the  following  general  points  deserve 
emphas i s . 

Rosenbrock  and  Storey  [36]  derive  an  expression  for 
the  covariance  matrix  of  parameters  determined  using  the 
least  squares  technique.  Heineken  et  al .  [37]  apply  this 
technique  to  the  estimation  of  confidence  limits  for  enzy¬ 
matic  reactions.  The  Cramer-Rao  inequality  [38]  is  often 
used  to  determine  a  limit  on  the  accuracy  of  the  parameter 
es t  imates . 

A  problem  related  to  the  estimation  of  parameter 
reliability  Is  the  definition  of  an  'adequate'  model. 

The  suitability  of  a  particular  model  form  is  usually 
strongly  dependent  on  the  application  or  end-use  of  the 
model.  For  example,  regulatory  control  systems  demand  much 
less  of  a  model  than  a  servomechanism  as  will  be  demonstrated 
in  Chapters  4  and  5*  Gupta  [39]  discusses  a  quadratic 
criterion  useful  for  model  comparison  and  discrimination. 

Frequently  it  is  the  reliability  of  the  output  re¬ 
sponses  prediced  from  the  model  that  is  of  interest  rather 
than  the  reliability  of  the  parameters  themselves.  For 
example,  a  very  low  reliability  for  a  parameter  that  has 
a  negligible  effect  on  the  model  output,  at  least  for 
conditions  of  current  interest,  need  not  be  of  concern. 


. 
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Since  a  function  of  a  random  variate  is  itself  a  random 
variate,  a  first-order  Taylor's  series  expansion  of  the 
model  output  in  terms  of  the  parameters  can  be  used  along 
with  reliability  estimates  for  the  parameters  to  furnish 
an  estimate  of  the  model  accuracy. 

Balakirev  and  Golubev  [40]  compare  the  accuracy  of 
several  methods  from  fourteen  previous  papers. 

1  . 3  Statistical  Estimation  Methods 

In  many  instances  the  estimation  of  parameters  in 
a  dynamic  model  can  be  reduced  to  the  simpler  problem  of 
estimating  parameters  in  an  algebraic  model  (cf.  section 
2.1  and  4.1).  Since  the  latter  estimation  problem  has 
received  considerable  attention  in  textbooks  and  other 
published  references,  only  a  brief  introduction  to  statis¬ 
tical  estimation  methods  will  be  presented  here.  A  more 
extensive  treatment  can  be  found  in  textbooks  on  mathe¬ 
matical  statistics,  the  text  by  Deutsch  [4l],  and  recent 
review  articles  [6,14,15,42,43]. 

For  purposes  of  discussion,  we  consider  the  algebraic 
model  in  equation  (8)  which  relates  a  scalar  output  y  to  the 
parameters  k  =  [k-j ,  ....  ,  k^]"^  and  inputs  x  =  [x-j ,  •••  > 


y  =  f(x,k)  +  e  (8) 

The  scalar  e  is  referred  to  as  the  residual  or  error  and 
by  definition  is  the  difference  between  the  observed  output 
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y  and  the  model  output  f(x.*k).  The  observed  values  of  y 
are  denoted  as  y ^ , y^ , . . . , y^  and  the  corresponding  obser¬ 
vations  of  x  as  ,  .  .  . ,  x^  .  The  classical  parameter 

estimation  problem  is  to  determine  an  estimate  k  such  that 
f(Xjk)  gives  the  'best  fit',  to  the  observed  values  y.  as 
defined  by  some  criterion  of  optimality  (i.e.,  performance 
index)  . 

Statistical  estimation  methods  are  usually  classified 
according  to  the  performance  index  that  is  selected  and 
the  a  priori  knowledge  about  the  residuals  that  is  utilized. 
These  features  are  summarized  in  Table  2  for  the  least- 
squares,  maximum-likelihood  and  Bayesian  estimation 
t echn  i  ques  . 

(a)  Lyy-i  t  _Sgua  res  [6,i4,4i] 

In  this  popular  approach  the  objective  is  to  determine 
the  parameter  estimate  k  which  minimizes  S,  the  sum  of 
the  squared  residuals  for  the  N  observations: 

T  N  2 

s  =  s  e  =  s  '  £j  (9) 

i  =  )  ' 

where 

e.  =  yj  -  f(XjJ<).  0°) 

If  the  model  equations  are  linear  in  the  parameters  k,  but 
not  necessarily  in  the  inputs  x,  the  minimization  results 

A 

in  an  analytical  expression  for  _k  and  the  approach  is 
referred  to  as  linear  least  squares  or  multiple  linear  regres¬ 


sion. 


COMPARISON  OF  STATISTICAL  ESTIMATION  METHODS 
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The  method  of  linear  least  squares  produces  efficient 
unbiased  estimates  if  the  residuals  are  uncorrelated  and 
follow  the  same  probability  distribution  [6,41]. 

(b)  [6,11,41] 

The  1  east -squa res  approach  can  be  general  ized  by 
including  a  weighting  matrix  W  in  the  performance  index: 

T  N  N 

S  =  e  We  =  2  E  e  .w  .  .  e  .  (11) 

-  i=l  j=l  1  1 J  J  1  ' 

Often  the  elements  of  the  weighting  matrix  are  selected 

to  reflect  the  existing  knowledge  about  the  relative 

precision  or  importance  of  the  residuals.  This  approach 

is  particularly  useful  when  several  output  variables  are 

measured  with  different  degrees  of  precision.  Assume  the 

residuals  have  zero  means  and  a  covariance  matrix  R_,  i.e. 

R  =  E( ee^)  where  E  denotes  the  expectation  operator.  Then 

the  selection  of  W  =  R  ^  produces  a  Markov  or  a  'minimum 

variance  estimate'  [4l ]  which  minimizes  the  weighted  least- 

squares  criterion  S  in  equat  ion  (11). 

(c)  j_mum_L_[ken hood  [41,44,45] 

This  powerful  approach  requires  that  an  assumption  be 
made  concerning  the  form  of  the  joint  probability  density 
function  of  the  residuals,  p(£).  The  parameters  in  this 
density  function  need  not  be  specified  but  can  be  estimated 
along  with  the  model  parameters  _k. 


. 
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The  likelihood  function  L(_k)  is  usually  defined  as 
the  conditional  probability,  p(_y.|k),  relating  the  output 
measurements  to  the  model  parameters  k: 

L(J<)  =  P(ylJ<)  (12) 

If  the  model  is  linear  in  k  and  the  residuals  are 
Gaussian,  it  can  easily  be  shown  that  [46,47]: 

p(Xlk)  =  p(_e)  (13) 

and  consequently  L(k.)  can  be  expressed  as: 


L(k) 


PU) 


(14) 


Orice  the  form  of  the  joint  probability  density  function 
p(_e)  has  been  assumed,  parameter  estimates  are  determined 
by  maximizing  L(_k)  with  respect  to  _k.  If  the  values  of  cer¬ 
tain  distribution  parameters  in  p(_e)  such  as  means, 
variances,  etc.  are  left  unspecified,  they  also  can  be 
estimated  by  maximizing  L(k) . 

The  maximum-likelihood  analysis  undergoes  considerable 
simplification  if  the  residuals  are  assumed  to  be  uncorre¬ 
lated  and  follow  normal  (Gaussian)  distributions  with 
zero  means  [11, 1 4  ] .  In  this  special  case: 


P(.£)  =  PI(e1)P2(e2)  •••  pdeld 


(15) 


' 


28 


where  the  density  function  for  the  ith  residual  is 
g  i  ven  by : 


2 

P  j  (  e  i )  =  (.2  wc2)~1/2  exp  ( - '—)  (16) 

2  a  ■ 

2  .  p 

and  a .  is  the  variance  of  e..  If  the  cr  j  are  known,  maxi¬ 
mizing  the  likelihood  function  is  equivalent  to  minimizing 
the  weighted  least-squares  criterion  in  equation  (11) 
with  W  given  by  [11,14]: 

-1 


(17) 


This  selection  of  the  matrix  W  also  results  in  a  minimal 
variance  parameter  estimate  [11, 14], 

The  assumption  of  Gaussian  uncorrelated  residuals 
greatly  simplifies  the  analysis  but  is  often  difficult  to 
justify  from  physical  considerations.  It  is  important  to 
note  that  the  residual  e  in  equation  (8)  reflects  both 
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modelling  errors  and  measurement  errors.  While  the  measure¬ 
ment  errors  may  follow  a  normal  distribution  to  a  reasonable 
approximation,  modelling  errors  often  are  strongly  corre¬ 
lated  with  the  independent  variables  x.  For  example,  if  a 
linear  model  is  used  to  represent  a  highly  non-linear 
system  over  a  wide  range  of  conditions,  the  residuals  would 
be  correlated  with  x  and  consequently  would  not  be  normally 
distributed.  Refer  to  [15]  for  an  instructive  example. 

(d)  ^^y.95.j_an _E s t _[mat |on  [6,46, 47] 

Bayesian  estimation  plays  an  important  role  in  statis¬ 
tical  dec  i  s  iontheo ry  and  also  provides  a  useful  conceptual 
framework  for  parameter  estimation.  The  Bayesian  approach 
requires  knowledge  of  two  probability  density  functions: 
first,  p(_e)  ,  the  joint  probability  density  function  for  the 
residuals,  and  second,  p(k),the  a  priori  information  con¬ 
cerning  the  model  parameters  to  be  used  in  the  analysis. 

For  example,  p(k)  could  incorporate  results  from  previous 
experiments,  judgemental  information  or  constraints  on  the 
parameters  arising  from  physical  considerations  [11].  If 
a  prior?  information  about  k  is  not  available,  it  is  or¬ 
dinarily  assumed  that  all  values  are  equally  likely. 

A.  basic  concern  of  the  Bayesian  approach  is  the  cal¬ 
culation  of  the  a  posterior?  conditional  density  function, 
P(Jilx)  •  This  probability  density  function  represents  know¬ 
ledge  of  the  parameters  after  the  measured  values  of  and 
x  are  available  [46].  To  evaluate  p  ( J<  (_z)  Bayes'  rule 


[46,47]  is  used: 


P(J<U) 


P(ili<)  P(k) 
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P(X) 


Since  the  a  prior?  density  function  p(k)  is  assumed 
and  p  I  is)  ?s  available  from  equation  (13),  p(_y)  can  then 
be  calculated  from: 


(19) 


—  CO 


The  evaluation  of  p(\/)  may  require  multiple  numerical 
integration  if  p(_k)  is  not  available  in  analytical  form. 

After  p(_k|_y_)  has  been  calculated,  it  is  used  to  deter¬ 
mine  estimates  of  k  which  are  optimal  according  to  some 
performance  index.  Three  possible  estimates  are  as  follows 


[46,47]: 


(i)  The  most  probable  estimate  (or  unconditional) 

A 

maximum-likelihood  estimate,  ,  is  the  mode  of 
p(kl^)  since  it  satisfies  the  following 
re  1  at  ion : 


=  max  p(j<!jy.) 
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(ii)  The  minimal  variance  estimate  (o r.  con d  i  t i ona 1 

A 

mean  estimate),  k^,  minimizes  the  following 
integral: 


00 


-  k  ||  2p(kix)  dk 
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This  estimate  is  also  referred  to  as  the  equal- 
risk  estimate  since  it  is  equally  probable  that 
the  true  value  of  _k  is  larger  or  smaller  than 

A  #  A 

J<2  •  The  estimate  k  is  also  equal  to  the  con¬ 
ditional  mean,  E(k|_y),  where  E  denotes  the 
expectation  operator. 

(iii)  The  minimax  estimate  (or  minimum  error  estimates), 

A 

k^ ,  is  the  median  of  p(_kj_y_)  .  It  minimizes  the 
maximum  possible  error, ||_k  -  j<  ||  .  If  the  range 
of  J|_k||  is  -co  to  +  »,  as  in  a  normal  distribu¬ 
tion,  the  maximum  possible  error  is  also  infinite 
and  the  minimax  estimate  has  little  meaning. 

A  A 

If  p(k|_y.)  Is  Gaussian,  then  the  estimates  _k^  ,  and 
are  identical  [46,47].  Furthermore,  if  a  uniform  _a 
prior?  density  function  p(_k)  is  assumed,  the  most  probable 

A 

est  imate  is  identical  to  the  maximum-likelihood  estimate. 

2 .  PARAMETERS  IN  ORDINARY  DIFFERENTIAL  EQUATIONS 

Ordinary  differential  equations  serve  as  a  convenient 
mathematical  model  for  a  multitude  of  physical  systems. 

Such  models  are  mathematically  tractable  and  are  usually 
quite  attractive  from  a  computational  viewpoint.  Often  the 
form  of  the  differential  equations  is  suggested  from  the 
theory,  but  some  of  the  parameters  must  be  estimated  from 
experimental  data.  This  parameter  estimation  problem  is 
the  subject  of  this  section. 
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2 . 1  Differential  Approximation 
G^ne  ra  l_D_[s  cuss  j_on  [5,35] 

Consider  the  mathematical  model  represented  by  equation 

(  1 )  .  If  the  pa  rameters  are  time  invariant  (i.e.  jq(  t)  =  jd) 

and  all  the  state  variables  and  their  derivatives  are 

accessible,  the  original  estimation  problem  reduces  to  the 

simpler  problem  of  determining  parameters  in  an  algebraic 

model.  That  is  if  the  residuals  are  defined  by: 

_£  =  >S  "  u(t),  £]  (22) 


Then  the  statistical  estimation  methods  presented  in  the 
introduction  can  be  employed.  This  approach  for  estimating 
parameters  in  a  differential  equation  model  has  been 
referred  to  as  differential  approximation. 

Comput  a  t  _[onal_Techn  _[gues  _and_R  e]_  j_ba  j_I  _[t  y  _E  s  t  _i_ma  tes  [1  1  ,48] 

The  computational  problem  consists  of  locating  the 
minimum  or  maximum  of  an  algebraic  function  of  the  residuals 
(a  performance  index).  If  the  model  is  linear  with  respect 
to  the  parameters,  linear  regression  methods  furnish  an 
analytical  solution  [11,41,49].  Otherwise,  search  techniques 
can  be  used.  Recent  texts  [36,50,51]  and  papers  [52-58]  on 
optimization  methods  should  be  consulted  for  a  description 
of  various  gradient  and  direct-search  methods.  Bard  [59] 
has  made  a  comparison  of  gradient  methods  and  reported  that 
the  Gauss-Newton  approach  is  the  most  efficient.  Greenstadt 
[60]  also  compares  gradient  methods.  Marquardt's  method  [56] 
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has  been  popular  in  industrial  applications.  Henley  and 
Rosen  [6l]  present  a  computer  programme  for  this  method. 

A  thorough  treatment  of  the  estimation  of  the  accuracy 
of  the  parameter  values  is  presented  by  Booth  and 
Peterson  [57] • 

E. x  g e  r  h m e  n  t  a  1  _  1  e  c h  n  [ q u  e  s 

In  relatively  few  situations  can  the  state  variable 
derivatives  be  measured  directly.  Two  examples  are  re¬ 
cycle  [62]  and  differential  reactors  [63]  which  allow  re¬ 
action  rates  to  be  obtained  by  direct  measurement.  If 
the  derivatives  are  not  available,  they  must  be  approxi¬ 
mated  by  numerical  d  i  f fe ren t i at  ion  or  filtering,  an  un¬ 
attractive  prospect  for  noisy  output  data, 
t i°Qs 

The  excellent  survey  article  by  Bard  and  Lapidus  [11] 
reviews  applications  to  chemical  reaction  systems.  Com¬ 
putational  examples  are  presented  in  the  text  by  Sage  [35]- 
A  recent  application  of  the  method  to  the  dynamic  modelling 
of  a  steam  generator  has  been  reported  [64].  This  tech¬ 
nique  has  also  been  used  to  determine  lateral  stability 
parameters  from  flight  data  [65*66]. 

Kittrell  et  al .  [67]  show  that  a  non-linear  least- 

* 

squares  analysis  is  superior  to  the  conventional  linearized 
data  analysis  for  a  Hougen-Watson  kinetic  model.  Non-linear 
least  squares  [67*68]  is  demonstrated  to  be  useful  in  model 
discr  iminat ion. 
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2  •  2  Parameter  Optimization 

[11,12,69] 

A  principal  concern  of  modern  control  theory  is  the 
determination  of  optimal  policies.  If  the  parameter 
estimation  problem  is  formulated  as  an  'optimal  control 
problem1,  then  a  parameter  estimate  is  desired  which 
optimizes  a  selected  performance  index.  This  formulation 
offers  the  advantage  that  the  wide  variety  of  analytical 
and  computational  methods  used  in  optimal  control  theory 
is  also  available  to  determine  optimal  parameter  estimates. 

Assume  that  the  system  of  interest  is  represented  by 
equations  (1)  and  (2)  and  that  the  state  variables  (but 
not  their  time  derivatives)  are  available.  For  convenience, 
the  weighted  least-squares  criterion  in  equation  (23)  is 
selected  as  the  performance  index: 


N 

E 

i  =  1 


(23) 


J 


where  the  residual  e.  is  defined  as  the  difference  between 

—  i 

the  measured  output  .  and  the  predicted  output  h.(X|,.y.j) 
at  the  ith  sampling  instant,  i.e. 


e  . 

—  i 


(24) 


The  positive  sem  i -def i n i te  weighting  matrices  Wj  are  often 
selected  to  reflect  the  relative  accuracy  of  the  output 
measurements  [12].  The  optimal  parameter  estimate  which 
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minimizes  J  will  be  denoted  by  jD*(t). 

The  various  techniques  available  tor  solving  optimal 
control  problems  have  been  classified  by  Lee  [47]  as 
either  direct  or  indirect  methods.  Indirect  methods  de¬ 
rive  the  necessary  conditions  for  optimality  and  then 
attempt  to  determine  parameter  estimates  which  satisfy 
these  conditions.  These  methods  will  be  discussed  in 
section  2.3-  Direct  methods  seek  optimal  estimates  in  a 
direct  fashion  through  optimization  of  the  performance 
index.  The  remainder  of  this  section  will  be  concerned 
with  a  particular  direct  method  referred  to  as  parameter 
optimization.  Other  direct  methods  such  as  dynamic 
programming  can  also  be  used  [35*70]. 

Compu  tat  j_onal_Techn  j_gues_and_RelJ_ab|7it  7_E  s  t  _[mat  es 

In  the  parameter  optimization  method,  the  optimal 
estimate  is  located  by  using  search  techniques  to  mini¬ 
mize  the  performance  index.  After  an  initial  guess  of 
the  parameters  is  made,  equation  (1)  is  integrated  and 
the  performance  index  J  evaluated.  New  parameter  values 
are  generated  and  the  integration  and  evaluation  of  J  is 
repeated.  The  iterative  calculations  continue  until  no 
further  improvement  in  the  value  of  J  can  be  obtained. 

Unless  hybrid  computation  [71,72]  is  utilized,  numerical 
Integration  is  usually  required  which  can  be  time  consuming. 


Davison  [73]  presents  a  rapid  algorithm  for  large 
linear  dynamic  systems. 

For  time-varying  parameters,  parameter  optimization 
appears  to  be  less  promising  than  the  estimation  methods 
presented  in  sections  2.3  and  2.4. 

Ex  2.2  ELTIPQtpl-lpch  ‘21922  § 

Either  discrete  or  continuous  measurements  of  the 
system  outputs  are  required. 

Applications 

Bard  and  Lapidus  [11],  Peterson  and  Lapidus  [74], 
Himmelblau  et  al.  [75]  and  Mesaki  and  Butt  [76]  discuss 
the  estimation  of  reaction  rate  constants  from  integral 
conversion  data.  Chen  et  al.  [77]  applied  the  conjugate 
gradient  technique  to  the  identification  of  aircraft 
parameters . 

2 . 3  Methods  Based  on  Optimal  Control  Theory 
G  ene  ra  l__D|scu  s  s  ion  [12,35*47, 78-82  ] 

As  mentioned  in  section  2.2  the  indirect  approach  for 
solving  optimal  control  problems  consists  of  deriving  the 
necessary  conditions  for  optimality  and  then  attempting 
to  determine  parameter  estimates  which  satisfy  these  con¬ 
ditions.  In  this  section  we  will  consider  an  indirect  ap¬ 
proach  which  has  been  predominant  in  the  optimal  control 
1 i tera tu  re . 
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The  derivation  of  the  necessary  conditions  which 
J3*(t)  must  satisfy  is  easily  accomplished  using  analytical 
methods  such  as  the  calculus  of  variations,  dynamic  pro¬ 
gramming  or  Pontryagin's  maximum  principle  [35*70,83]. 

An  iterative  computational  method  is  then  used  in  which 
the  successive  estimates  of  ja*(t)  are  forced  to  satisfy 
the  necessary  conditions  and  (hopefully)  will  converge 
to  ja*(t).  One  advantage  of  this  indirect  approach  is 
that,  in  principle,  the  optimal  estimate  can  be  determined 
analytically.  Unfortunately,  this  advantage  is  seldom 
realized  since  the.  necessary  conditions  Inevitably  require 
the  solution  of  a  non-linear  two-point  boundary  value 
problem  (TPBVP),  a  difficult  computational  problem  [35]- 
Computational  techniques  for  solving  the  TPBVP  can 
be  conveniently  classified  as  sequential  or  nonsequential. 
In  the  sequential  approach,  parameter  estimates  are  genera¬ 
ted  at  each  sampling  instant  tj.  Consequently,  this 
approach  is  particularly  well  suited  for  on-line  estimation 
since  storage  requirements  are  greatly  reduced.  In  non¬ 
sequential  methods  the  calculations  are  not  begun  until 
after  all  the  data  have  been  obtained* 

Gradient  methods  provide  a  nonsequential  approach 
which  has  been  widely  used  with  considerable  success 
[35,70,84].  However,  convergence  of  gradient  techniques 
near  the  optimum  est imate  £* ( t )  is  often  slow  [35,70]. 
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Second  variation  methods,  an  extension  of  the  gradient 
method,  converge  rapidly  near  the  optimum  but  required 
good  initial  estimates  of  £*(t).  They  also  greatly  in¬ 
crease  the  computational  requirements  [35,70]. 

Quas  i -1  inea r  i  zat  ion  is  another  nonsequential  method 
that  has  received  considerable  attention  [35*78,85,86,87]. 
introduced  into  the  control  literature  by  Bellman  and 
Kalaba  [88-90],  quasi-linearization  is  a  modification  of 
the  Newton-Raphson  technique  for  functional  equations 
[91].  It  converts  the  non-linear  boundary  value  problem 
into  a  series  of  non-stat ionary  linear  boundary  value 
problems.  Since  quas  i -1  inea r  i  zat i on  exhibits  quadratic 
convergence,  convergence  is  rapid  when  it  does  occur. 
Unfortunately,  the  region  of  initial  parameter  estimates 
which  results  in  convergence  can  be  quite  small.  Donnelly 
and  Quon  [92,93]  have  proposed  an  algorithm  to  overcome 
the  convergence  problem.  Gradient  methods  and  differential 
approximation  have  been  successfully  used  as  a  starter  for 
quas  i -1  inea r  i  zat ion  [5,35*9^]*  Another  computational  dif¬ 
ficulty  is  that  a  set  of  ill-conditioned  linear  equations 
often  result  when  the  number  of  parameters  (and  unknown 
initial  states)  to  be  estimated  is  quite  large  [78]. 

In  the  next  chapter  an  algorithm  which  combines  quasi- 
1  inear  izat  ion  and  linear  programming  is  demonstrated  to 
be  versatile.  In  particular,  constraints  on  parameters  or 
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states  are  easily  incorporated  into  the  analysis  and  can 
be  used  to  extend  the  region  of  convergence.  This  approach 
requires  the  selection  of  a  linear  performance  index  [95]* 
rather  than  a  non-linear  index  such  as  the  least-squares 
cr  i  ter  ion . 

Lee  [96]  discusses  the  extension  of  a  quasi¬ 
linearization  analysis  to  systems  with  t  ime-va r  iabl e 
pa ramet e rs  . 

A  sequential  solution  to  the  non-linear  estimation 
problem  is  also  referred  to  as  a  non-linear  filter  since 
current  state  estimates  as  well  as  parameter  estimates  are 
generated  as  the  output  measurements  become  available. 

Most  non-linear  filtering  techniques  utilize  linearization 
at  some  point  in  the  analysis  [12].  Comparisons  of  sub- 
optimal  non-linear  filters  are  available  [97~99] •  Invariant 
imbedding  is  a  promising  sequential  technique  that  has  been 
used  in  several  investigations  [12,35*78].  Its  region  of 
convergence  is  considerably  larger  than  the  region  of  quasi- 
1  i near  i zat  ion  [78] . 

Compu ta t  Lena  l__Tech n]_gues _an d_R elj^ba  j_l  Lty_E s  t  jmiat es 

Several  recent  textbooks  on  optimal  control  place 
considerable  emphasis  on  compu tat  iona 1  methods  [35*76,70, 
100].  Review  articles  are  available  which  provide  an 
introduction  to  the  extensive  literature  on  optimal  con¬ 
trol  theory  [87,101,102]  and  applications  to  parameter 
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estimation  [12,103-114]. 

Sequential  estimation  methods  au toma t i ca 1 1 y  generate 
an  approximation  to  the  covariance  matrix  for  the  parameter 
estimates.  A  thorough  treatment  of  the  reliability  of 
parameter  estimates  obtained  from  quas i-1  inear izat  ion  is 
presented  by  Heineken  et  al .  [37].  Refer  also  to  [36,115]. 
Reliability  est  imates  are  also  easily  obta  ined  when 
quas i -1  inea r  izat ion  and  linear  programming  are  combined  as 
demonstrated  in  Chapter  3* 
r_[ment  a  l__Techn  J_gues 

Either  discrete  or  continuous  measurements  of  the 
system  output,  j^(t),  and  input,  _u(t),  are  required. 

^QQlica t  jon s 

Sequential  estimation  methods  have  been  applied  to 
chemical  reactors  [2,78,116,117],  paper  making  [118-120], 
navigation  systems  [13,104,121-123]  and  steel  making  [124]. 
Applications  of  nonsequen t ia 1  methods  include  chemical 
reaction  systems  [12,37,78,92,125,126],  and  biomedical 
systems  [127,128].  It  is  noteworthy  that  several  applica¬ 
tions  utilized  experimental  data  from  industrial  processes 
[116,118,119,124].  In  Chapter  3  off-line  ident  i  f  i  cat  ion 
of  a  pilot  plant  evaporator  is  presented. 
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2  •  4  Mode]  Reference 

G§Q§I§J~Qiscyss_[qn  [129-133  ] 

In  the  model  reference  or  learning  model  approach 
[134],  parameters  in  an  assumed  model  are  adjusted  until 
the  model  and  plant  outputs  become  identical.  The  input 
u_(t)  to  the  plant  is  measured  and  fed  to  the  model;  the 
difference  between  the  measured  plant  output  and  the  model 
output  is  used  in  an  adaptive  loop  to  adjust  the  model 
parameters  (see  Figure  1).  The  parameter  adjustment  is 
usually  done  on  a  sequential  basis  but  could  be  done  non- 
sequentially  [135].  Model  reference  methods  have  received 
considerable  attention  as  indicated  by  the  large  number 
of  papers  in  recent  I.F.A.C.  symposia. 

The  model  reference  approach  has  also  been  widely 
used  to  design  adaptive  control  systems  [133]«  Since  the 
adaptive  control  and  i dent  i  f  i  cat  ion  problems  are  'dual 
problems',  the  parameter-adjustment  algorithms  developed 
for  adaptive  control  can  also  be  used  for  i dent  i  f  icat  ion 
[133,136,137].  The  simplicity  and  sequential  nature  of 
the  model  reference  approach  make  it  attractive  for  on-line 
applications  such  as  tracking  time-varying  parameters. 
Flowever,  convergence  to  the  actual  parameter  values  and  an 
acceptable  rate  of  convergence  may  be  difficult  to 
guarantee  [136,133]. 


il(  t) 
i  nput 


FIGURE  1:  Model  Reference  Approach  to 
Parameter  Estimation 
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ComQuta 1 2ona3_Techn]_gues _and_R el_i_abj_|j_t \/_E s t _[ma t es  [ 1 39~ 1 42  ] 
Two  design  strategies  have  received  the  most  attention, 
in  the  first  approach,  the  pa ramete r-adjus tment  scheme  is 
designed  to  minimize  a  performance  index  based  on  the  pro¬ 
cess  and  model  outputs.  Popular  performance  indices  have 
included  the  integral  squa red-e r ro r  criterion  and  algebraic 
functions  of  the  instantaneous  outputs  and  their  time 
derivatives  [130,143-147].  Certain  difficulties  assoc¬ 
iated  with  algebraic  performance  indices  have  been  noted 
by  several  authors  [130,143,147].  The  requ  i  red  minimiza¬ 
tion  is  typically  achieved  by  using  gradient  techniques 
[130,147-149]  or  the  related  method  of  stochastic  approxi¬ 
mation  [150-157]  to  develop  a  parameter  adjustment  law  of 


f o 1  lowing 

form: 

(25) 

dt  =  cJ(e)] 

J(e)  = 

scalar  performance  index. 

_e 

output  error  =  (model  output) 

-  (plant  output) 

ii 

gradient  with  respect  to  the 

adj  us  t ab 1 e 

model  parameters,  jd. 

K 

constant  mat  r ix . 

The  gradient  has  often  been  evaluated  from  sensitivity 
equations  [7, 130 , 1 32 , 1 43 , 1 5S~ 1 61 ] .  The  use  of  'state- 
variable  filters'  [147,162]  can  improve  stability  and  con¬ 
vergence  properties. 
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A  second  popular  approach  is  to  use  Liapunov's 
second  method  to  ensure  the  stability  of  the  resulting 
model  reference  system.  This  approach  has  enjoyed  con¬ 
siderable  success  for  mu  1 1  i  va r i ab 1 e  linear  systems 
[163-166].  However,  at  present  the  resulting  parameter- 
adjustment  algorithms  require  all  state  variables  to  be 
accessible.  Landau  [167]  has  demonstrated  that  Popov's 
method  also  provides  a  systematic  approach  for  designing 
globally  stable  adaptive  systems. 

A  less  attractive  approach  is  to  competitively 
rate  a  collection  of  models.  However,  large  computer 
times  are  necessary  [5,168]. 
r  |men  t  a  l__Techn2gues 

Some  model  reference  algorithms  require  all  state 
variables  to  be  measured;  other  algorithms  requ  i  re  only 
output  measurements. 

^E^Hcat  _[on  s 

The  problem  of  auto-pilot  design  motivated  much  of 
the  early  work  in  this  field  [133]-  The  survey  article  of 
Maslov  and  Osovskii  [169]  lists  applications  of  the  model 
reference  approach  in  chemical  and  metallurgical  processes, 
aeronautics  and  electrical  engineering.  Refer  also  to  the 
text  by  Eveleigh  [133]  and  additional  survey  articles  [129* 
132].  A  model  reference  control  system  has  also  been  re¬ 
ported  for  nuclear  rocket  engines  [170].  Bell  [171]  pre- 
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sents  a  hybrid  computer  study  of  a  model  reference  para- 
meter-tracking  system.  Porter  and  Tatnall  [172]  report 
the  performance  of  an  adapt ive  hydraulic  servomechanism. 

2 •  5  Step  Response 

GEQEE2l_ 2122222122  [173# 174] 

Low-order,  s  i ng 1 e- input ,  single-output  systems  are 
often  characterized  by  'time  constants'  which  indicate 
the  speed  of  response  of  the  system.  The  transient  response 
to  a  step  change  in  an  input  variable  can  be  used  to  deter¬ 
mine  these  time  constants  and  time  delay,  if  any,  which 
characterize  the  system.  This  method  has  been  widely 
used  since  it  is  simple  to  apply  and  easy  to  interpret. 
However,  the  test  is  very  sensitive  to  other  disturbances 
[7# 175] *  This  method  is  often  used  when  approximating 
a  higher-order  system  by  a  second-order  model  with  a  time 
del  ay  [176] . 

2201222 a t  kgna l__Techn|gues _and_R e H §b  j.  M  t  y_E  s  t  |ma  t  es 

The  0 1 denbourg-Sartor ius  method  and  the  slope  inter¬ 
cept  (or  percentage  incomplete)  method  can  be  used  to 
estimate  time  constants  [173#174].  These  simple,  graphical 
methods  eliminate  the  need  for  machine  computation.  The 
parameters  can  also  be  determined  by  curve  fitting  the  re¬ 
sponse  data  [177-179]*  If  the  system  is  approximated  by  a 
first-order  lag  plus  dead  time,  the  parameters  can  be  ob¬ 
tained  directly  from  a  plot  of  the  step  response  [175]* 
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^><9.e  £  en  t  a  l_Iech  n  J_Que  s  [173*  180  J 

A  step  change  in  an  input  variable  is  introduced  and 
the  transient  response  is  recorded.  Attempts  have  been 
made  to  reduce  experimental  time  by  trajectory  extra- 
polat  ion  [l8l  ]. 

Cheruy  and  Menendez  [175]  made  an  experimental  com¬ 
parison  of  step,  pulse  and  random  signal  testing  using 
an  electric  furnace.  Bakke  [182]  used  a  "modified 
step  response  method"  to  determine  the  parameters  in  a 
first-order  plus  delay  model  of  a  pilot  plant  distilla¬ 
tion  unit.  Laspe  [178]  investigated  the  dynamic  behaviour 
of  an  oil-cracking  furnace. 


2 . 6  Repeated  Integration 
G2Q^I§l_Qiscuss j_on  [183,184] 

In  this  approach,  repeated  integration  of  input  and 
output  data  is  used  to  estimate  parameters  in  t ime- i nva r i ant 
linear  systems.  For  purposes  of  illustration,  consider  the 
following  nth-order  s i ng 1 e- i npu t ,  single-output  system  where 
the  a's  and  b's  are  unknown  parameters  (n  )  m) : 


i(n) 


V 


n  dt 


+ 


b i  «  +  y(t> 


iM 


U 


m  dt 


+ 


du 
1  dt 


(26) 


+ 


o 


^7 


If  equation  (26)  is  integrated  numerically  n  times  from 
0  to  T,  an  algebraic  equation  which  is  linear  in  the  a's 
and  b's  results  [183].  Since  there  are  n  +  m  +  1 
parameters  to  be  identified,  either  n  +  m  +  1  experimental 
output  responses  are  required  or  a  single  output  response 
can  be  used  if  the  repeated  iriteg rat  ions  are  performed 
for  n  +  m  +  1  different  time  intervals.  In  either  case, 
if  the  resulting  set  of  n  +  m  +  1  algebraic  equations  is 
linearly  independent,  the  a's  and  b's  can  easily  be 
determ i ned . 

This  approach  to  parameter  estimation  has  mainly  been 
used  for  linear  systems.  However,  Diamesis  [185],  Wang 
f 1 86 ]  and  Radtke  ri87]  have  extended  this  method  to  systems 
with  polynomial  non- 1 i nea r i t i es . 

Computatmnal_Techn_igues_and_ReHab  i  lit y__E s t  jma t es  [188, 189] 

A  major  source  of  difficulty  is  encountered  in  ob¬ 
taining  a  set  of  independent  linear  algebraic  equations. 

If  response  data  from  a  single  experimental  test  are  to  be 
used,  Murrill  et  al .  [183]  recommend  taking  at  least  5n  data 

points.  If  results  from  several  experimental  tests  are  to 
be  used,  the  forcing  function  (inputs)  must  be  linearly 
i independent . 

^-><9:^  rg  J_men  t  a  1  _T[e  ch  n  e  s 

An  arbitrary  disturbance  is  introduced  into  the  system 
via  the  input  u(t).  The  input  and  output  y(t)  are  recorded 
at  every  sampling  instant. 


■i 
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^QElicat  j_ons 

Heimlich  and  Gruet  [190]  applied  this  method  to  a 
fluidized  bed  system.  Schneider  [191]  used  this  techni¬ 
que  for  process  identification  in  an  adaptive  feed¬ 
forward  control  scheme. 

3 •  PARAMETERS  IN  AN  ANALYTICAL  SOLUTION 

The  most  time-consuming  computational  step  in  most  of 
the  methods  for  estimating  parameters  in  differential 
equations  (cf.  section  2)  is  the  integration  of  the  model 
equations  which  must  be  done  for  each  iteration  of  the 
parameter  estimation  procedure.  This  integration  step  can 
be  avoided  if  an  analytical  solution  exists  for  the  system 
equations.  For  example,  the  time-varying,  mu  1 1 i -var i ab 1 e , 
linear  system  described  by  equation  (3)  has  the  solution 
[192]: 

rt 

x(t)  =  j&(t,tQ)  x(tQ)  +  ^  .  j£(t,S)B(  S)u(  §)d?  (27) 

t 

o 

where  the  fundamental  or  transition  matrix  is  defined  by: 

=  Af t)  Ji(t,t0)  (28) 


w  i  th 


(29) 


^9 


For  t  ime- inva r ian t  systems  the  solution  is  considerably 
simpler  and  is  given  by  equation  (7). 

The  estimation  problem  is  now  to  determine  the  un¬ 
known  parameters  in  the  transition  matrix  given  measured 
values  of  the  system  input,  _u(t),  and  output  _y_(t).  No 
integration  is  required  but  the  estimation  problem  is 
non-linear  and  the  solution  may  be  difficult  since  some 
of  the  parameters  will  occur  in  the  arguments  of  expon¬ 
ential  or  transcendental  functions  as  discussed  in 
sect  ion  1.1  ( b) . 

This  approach  is  frequently  used  in  low-order,  or 
s  i  ng 1 e- i  nput ,  single-output  systems  and  usually  requires 
simplifying  assumptions  which  permit  an  analytical  solu¬ 
tion  to  be  obtained  or  which  reduce  it  to  a  set  of  estima¬ 
tion  problems  which  can  be  solved  independently  or  se¬ 
quentially.  Many  react  ion  kinetics  and  catalysis  mechanism 
problems  fall  into  this  category. 

Heymann  et  al .  [193]  present  a  time-domain  technique 
for  the  identification  of  linear,  t  ime- inva r i an t ,  single¬ 
output,  single-input  systems.  The  model  is  identified 
using  a  pseudo-state-space  formulation  and  a  two-stage 
solution  procedure  which  identifies  the  system  poles  (i.e. 
weighting  function  or  fundamental  matrix)  and  then  the 
'complete  model1  (i.e.  poles, zeros  and  lags).  The  second 
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step  involves  analytic  differentiation  of  the  weighting 
function  and  solution  of  a  set  of  linear  algebraic 
equations.  The  principal  advantages  are  that  the  solu¬ 
tion  is  all  in  the  time  domain,  repeated  integrations 
rather  than  differentiation  of  the  response  data  are 
used,  and  the  method  evaluates  confidence  limits  simul¬ 
taneously  with  the  parameter  estimates.  For  an  nth-order 
system,  n  linearly  independent  response  functions  are  re¬ 
quired  and  in  practice  this  limits  the  model  to  relatively 
low  orders.  The  authors  report  applications  to  second 
and  third-order  systems  simulated  on  an  analogue  computer, 
an  operating  chemical  plant  and  a  stirred  tank  heat  ex¬ 
changer.  They  conclude  that  this  is  a  .useful  technique 
for  linear  systems  and  has  'modest'  computational  require¬ 
ments  . 

3 . 1  Search  Techniques 

0.  E2 1_Q  1222:1  §.l2Q 

The  parameter  estimation  problem  is  analogous  to  that 

of  section  2.1  where  the  object  is  to  minimize  a  function 

of  the  residuals  with  respect  to  the  parameters,  jd. 

Computational  Techniques  [19^1  and  Reliability  Estimates 
[11,57] 

in  the  general  case,  non-linear  estimation  techniques 
are  required  and  the  search  techniques  discussed  in  section 

2.1  are  applicable.  However,  numerical  or  analogue  inte- 
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gration  techniques  need  not  be  incorporated  since  the 
analytical  solution  is  available  in  closed  form. 
I^B^bllI!^rIta2_Techn  _[gue 

Transient  data  are  recorded  for  known  or  measured 
disturbances  and  the  trajectories  are  fitted,  usually  by 
least  squares.  State  derivatives  are  not  required. 

_[cat  j_ons 

Ball  et  al.  [195]  apply  this  method  to  reaction 
kinetic  systems.  Berry  [196]  uses  Rosenbrock's  method  of 
rotating  coordinates  [36]  to  identify  parameters  in  the 
solution  to  low-order  models  of  a  pilot-plant  binary 
distillation  column.  Latour  et  al.  [177]  employ  Marquardt's 
method  to  determine  the  parameters  in  a  second-order  model 
used  for  control  purposes.  Moore  et  al.  [197]  use  a 
pattern-search  technique. 

3  •  2  Prony's  Method  of  Exponential  Approximation 
G  ^ner  a  1__D  j_scus  s  j_on 

The  homogeneous  solution  for  a  nth  order,  linear, 
t  ime- inva r  iant ,  single-output  system,  can  be  written  in  the 
following  fo  rm: 

n 

y(t)  =  I  K.tJ  exp(X.t)  (30) 

i  =  l 

where  eigenvalues,  X . ,  may  be  repeated  r  times  (O^j^(r-l)} 
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The  calculation  procedure  to  identify  the  parameters  Kj  and 
X.  involves  two  linear  regressions  and  the  determination 
of  the  roots  of  an  nth-order  polynomial.  However,  non¬ 
linear  regression  and  integration  of  the  system  differential 
equations  is  avoided. 

Q2Q3Ey£§ti°Q§l_I®£!!lQi9y§§,  D  98]  3Qd_Rel_j_ab  M_ |ty_E  st  jma  tes 
Denoting  the  sampling  time  as  T,  y(kT)  as  y  and 
exp  (X.T)  as  a  j  it  can  be  shown  [199]  that 


y 


m+n+  1 


n 

e 

=  1 


w 


•  y 

1  ym+ 


m  =  0,1,2,3,...,M 


(31) 


where  w.  is  dependent  only  upon  X.  and  T  and  can  be 

identified  by  using  least-squares  techniques  to  fit 

equation  (3.1)  to  experimental  data  where  M  ^n,  and  the  number 
of  data  points  is  greater  than  M  +  n. 

Once  the  w.  values  have  been  determined  the  values  of 

1 

a.  can  be  found  by  finding  the  roots  of  the  following 
polynomial  [199]: 

n  n  i-1 

a  =  E  w.  a  1  (32) 

i-1  1 

and  X  j  fol  lows  f  roni 

a .  =  exp  (Xjt)  (33) 

Since  the  modes,  a.,  are  now  known  the  values  of  Kj  can 
be  determined  by  fitting  equation  (30)  to  the  data  using 
techniques  such  as  linear  least  squares. 
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^>S9.e  j_men  t  a  l_Iech  Q_l.Qu  e 

Transient  responses  of  the  system  output,  y(kT), 
are  recorded  for  sets  of  initial  conditions  which  must 
be  chosen  to  excite  all  desired  modes  of  the  system. 

Aqq1_[  ca  t  J_on  s 

Chidambara  [200]  uses  this  technique  for  the  re¬ 
duct  ion  of  an  eighth-order  model  by  assuming  a  model  of 
order  four  and  determining  the  parameters  which  give  the 
best  'fit1  to  data  generated  by  the  eighth-order  model. 

It  should  be  noted  that  this  method  of  model  reduction 
does  not  necessarily  preserve  the  dominant  eigenvalues 
of  the  original  system.  Meier  and  Luenberger  [201] 
use  Prony's  method  as  a  starter  for  the  Wiener  filter. 

4 .  PARAMETERS  IN  A  DISCRETE  MODEL 

Discrete  models  have  received  a  great  deal  of  attention 
recently  because  of  the  rapidly  increasing  use  of  digital 
computers  for  on-line  data  acquisition  and/or  data  pro¬ 
cessing.  All  of  the  models  represented  by  equations  (1)  to 
(6)  can  be  put  into  discrete  form  by  replacing  the  continuous 
variable,  t,  by  kT  where  T  is  the  sampling  interval  and  k 
assumes  integer  values.  (In  this  work  it  is  assumed  that 
T  is  constant  and  is  normally  omitted,  so  that  x(t)  = 
x(k)  =  implies  that  t  =  kT ) . 
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Estimation  of  the  parameters  in  the  discrete  form  of 
equations  (!)  and  (2)  usually  requires  linearization  at  some 
stage  of  the  analysis  [12,35]- 

Treatment  of  the  discrete  linear  system  derived  from 
equations  (3)  and  (4)  involves  manipulation  of  the 
equations  so  as  to  obtain  a  difference  equation  which  re¬ 
lates  the  output  to  the  input  [22,35,77]- 

The  linear,  t  ime- i nva r  ian t  case  can  be  easily  treated 
analytically.  Under  the  assumption  that  u_(t)  is  constant 
over  the  sampling  interval,  it  can  be  shown  [192]  that  the 
analytical  solution  to  the  discrete  form  of  equations  (5) 
and  (6)  is: 


x(k  +  1 ) 

=  dx(k)  +  Aufk] 

(31*) 

x(k  +  i) 

=  G_x(k)  +  _v(k) 

(35) 

It  must  be  emphasized  that  this  is  not  a  numerical  approxi¬ 
mation  and  agrees  exactly,  at  the  sampling  instants,  with 
the  solution  of  the  equivalent  continuous  model. 

The  parameter  estimation  problem  associated  with 
equations  (34)  and  (35)  is  to  find  numerical  values  for 
the  elements  of  the  _<£  and  A  matrices  [202,203]-  Thus,  in 
this  sense  the  problem  is  analogous  to  section  3  which  dealt 
with  estimating  parameters  in  the  solution  to  a  different-* 
ial  equation.  However ,  since  &  and  A  are  analytical  func- 
tions  of  A  and  B  it  is  also  possible  towork  back  and  find 
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the  parameters  in  the  original  differential  equations  as 
discussed  in  section  1.1.  An  alternative  discrete  re¬ 
presentation  for  a  multivariable  dynamic  system  is: 

AZ(z-')  y(t)  =  BZ(z-1)  u(t)  (36) 

where 

n  =  order  of  the  state  vector 
m  =  dimension  of  the  input  vector  (m  (  n) 
z  =  z  transform  variable 
AZ  =  matrix  of  polynomials  of  order  n 
BZ  =  matrix  of  polynomials  of  order  m 

The  single  variable  form  of  equation  (36)  is  widely 
used  and  can  be  written  in  terms  of  the  pulse  transfer 
f unct  ion ,  G ( z) : 


G(z) 


m 

E  b  .  z 
i=0  1 


n 

E  a 
i  =0 


(37) 


where  q  is  a  time  delay  parameter  and  z  is  the  transform 
variable  such  that  z  '  indicates  a  pure  time  delay  of  i 
sample  periods.  Thus,  in  the  time  domain  equation  (37) 
becomes : 

n  m 

E  a.y(k-i)  =  E  b.u(k-i-q) 
i =0  1  i  =0 

where  k  is  the  time  interval  of  interest. 


(38) 
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The  estimation  problem  is  then  to  estimate  the  parameters 
a.  and  b.  given  a  time  series  of  data  for  y  and  u.  It 
should  be  noted  that  one  coefficient  can  be  eliminated  by 
dividing  both  sides  of  the  equation  by,  say  b^ . 

The  above  equations  were  derived  from  the  state  space 
or  matrix  models  of  the  system.  An  alternative  approach 
which  is  widely  used,  and  particularly  suitable  for  linear 
control  systems,  is  based  on  'block  diagram'  and  'transfer 
function'  written  in  terms  of  the  Laplace  variable,  s, 
or  the  z-transform  variable,  z.  Digital  simulation  pro¬ 
grammes  are  available  which  also  convert  from  the  Laplace 
transform  to  an  equivalent  state-space  formulation  [204] 
or  to  handle  mixtures  of  Laplace  and  z-transforms  [205]. 
These  methods  can  be  used  [206]  for  determining  discrete 
approximations  (in  the  form  of  equation  (36)  or  (38))  for 
continuous  systems.  The  advantage  lies  in  faster  evalua¬ 
tion  of  the  transients  from  the  system  model  and  is  particu 
larly  important  for  real-time  digital  simulation  studies. 
The  ratio  of  computation  speeds  achieved  by  discrete  approx 
imation  vs.  numerical  integration  methods  -  for  the  same 
accuracy  -  has  been  more  than  a  hundred  to  one  in  some 
cases  [206]. 

Some  of  the  methods  based  on  optimal  control  theory 
(section  2.3),  such  as  quas i -1  inear i zat  ion  [207,208],  can 
be  formulated  to  apply  to  discrete  systems. 
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4 . ]  Statistical  Estimation 
General_D qscuss jon  [  1 4  1 

in  discrete  model  formulations  such  as  those  represented 
by  equations  (34)  to  (38)  the  problem  is  reduced  to  the 
estimation  of  parameters  in  an  algebraic  equation  and  a 
wide  variety  of  methods  is  available. 

CoQlQntat  _[ona]  _Iech n s _an d_R e l_[^a b s t  jmates  [38,209- 

211] 

The  method  of  linear  least  squares  which  provides  a 
convenient  method  of  analysis  if  the  model  is  a  true 
regression  model  leads  to  estimates  which  are  biased  and 
non-minimum  variance  when  both  _y_(t)  and  jlj  ( t )  are  corrupted 
by  noise  [14,212].  The  bias  caused  by  the  noise  can  be 
easily  compensated  for  if  trie  noise  properties  are  known. 
However,  this  is  not  the  situation  in  most  practical  pro¬ 
blems  and  other  approaches  [213-215]  must  be  employed  at 
the  expense  of  increasing  the  complexity  of  the  analysis. 
Other  pitfalls  of  linear  regression  were  related  by  Young 
[213 ]  and  Box  [212] . 

Least  squares  [214,216-220]  and  maximum  likelihood 
[221-227]  have  been  applied  extensively  to  s i ng 1 e- i nput , 
single-output  models.  Other  techniques  [228-233]  convert 
discrete  problems  to  the  s  domain  by  matching  root  loci 
of  the  discrete  and  continuous  system. 

Similarly  for  multi-input,  multi-output  systems  least 
squares  [13,118-120,124],  maximum  likelihood  [234-235]  and 
the  instrumental  variable  method  [13,162.236]  are 
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emp  Toyed . 

So  as  to  facilitate  on-line  identification  of  the  dis¬ 
crete  model,  recursive  schemes  have  been  presented  for  both 
single-output  [237-240]  and  multi-input,  multi-output 
[241-245]  process  ? dent i f i cat  ion . 

Use  of  the  Cramer-Rao  inequal ity  has  been  made  by 
Astrom  [38]  to  provide  an  estimate  of  the  reliability  of 
the  parameter  estimates. 

E-b^er  _[men  ta  l__Techn  j_que  [246] 

Discrete  time  series  data  are  needed  for  the  inputs 
and  outputs.  A  pseudo-random  binary  test  signal  is  a 
very  popular  forcing  function  [214].  Williams  and  Clarke 
[247]  present  a  state-of-the-art  paper  on  the  use  of 
pseudo-random  binary  sequences.  Menahem  [248]  employs  a 
multi-step  test  signal. 

AEQlicat jons  [246] 

Astrom  [2151  presents  an  application  of  computer  con¬ 
trol  of  a  paper-making  process  which  involves  identifica¬ 
tion  by  this  scheme.  Other  applications  to  the  paper  in¬ 
dustry  include  [118-120,226,249,250].  Wilkie  [251]  applies 
generalized  least-squares  and  maximum-likelihood  estima¬ 
tion  to  a  small  nuclear  reactor.  Computation  times  are 
reported.  Other  applications  are  to  a  distillation  column 
[252],  a  steel-making  process  [124],  determination  of 
aerospace  vehicle  parameters  [253,254],  oil  refinery  unit 
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[255],  a  paper  machine  [256],  aeronautics  [251]  and  a 
thermal  process  [258]. 


4 . 2  Ka lman  F  ?  1  ter  ?  ng 
Gene ral_D_[scuss  ion  [259-26l] 

In  general,  the  term  'filtering'  can  be  applied  to  any 
procedure  which  produces  an  updated  estimate  of  the 
desired  quantity  at  63011  sampling  instant.  The  classical 
approach  to  state  estimation  derived  by  Kalman  [261]  pro¬ 
vides  minimum-variance,  unbiased  estimates  of  the  state, 
x(t)  (for  systems  described  by  equations  (3)  and  (4)), 
based  on  measurements  of  the  output  vector,  _y_(t).  The 
linear  filter  is  stable  for  systems  that  are  observable 
and  con t  ro 1 1 ab 1 e . 

Estimates  of  unknown  parameters  can  be  obtained  by 
augmenting  the  state  matrix  so  that  it  contains  the  des¬ 
cribed  parameters  as  follows: 


z(t) 


x(t) 


(39) 


and  then  applying  state  estimation  techniques  [260],  The 
'augmented  models'  follow  directly  from  equation  (1)  to  (6) 
by  replacing  x(t)  by  _z(t). 

There  is  no  general  solution  for  the  non-linear  fil¬ 
tering  problem.  Therefore,  most  techniques  reply  on  local 
1  inear  izat  ion  to  yield  a  sub-optimal  filter  such  as  the 
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'extended  Kalman  filter'.  However,  in  this  instance  there 
is  no  guarantee  of  stability  of  the  filter. 

For  systems  wh  i  ch  can  be  adequately  represented  by 
the  following  equations: 


z(k  +  1)  =  +  J3(k)  jj(k)  (40) 

y(k  +  1)  C.(k)  jz(k)  +  v(k)  (4l) 

the  extended  Kalman  filter  has  the  following  form  [46]: 

P(k+])  =  F  [|(k)]H(k)d[|(k)]  +  B(k)fiBT(k)  (42) 

H(k)  =  P(k)-P(k)CT(k)  (R  +  C(k)P(k)CT(  k) ) -1C(  k)P(k)  (43) 

l(k+l)  =  1,  [z(k)  ,k]+H(k)CT(k)R"'(Y(k+l)-£(k+l)  f,  [z(k)  ,k])  (44) 
where  EQj(k)]  =  EQv(k)]  =  0  and 


£2  [l(  k)  ] 


il(k) 


which  is  simply  equal  to  j£(k)  for  the  linear  system.  The 
matrices  ^  and  R.  are  defined  as  covariance  matrices  of  the 
uncorrelated  random  inputs  _u(k)  and  v(k)  respectively. 

H_(k)  is  an  a  posterior?  covariance  matrix  in  the  algorithm. 
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Subopt imal  filter  equations  can  also  be  derived  using 
invariant  imbedding  [12,263-265].  For  t  ime- inva r ian t 
linear  systems  the  Wiener  filter  is  applicable  and  re¬ 
quires  significantly  less  computational  effort  [2661. 

It  should  be  noted  that  this  formulation  of  the 
parameter-estimation  problem  results  in  a  non-linear  set 
of  difference  equations  (which  must  be  solved  at  each 
time  interval)  even  for  models  that  are  1  inear  in  the 
augmented  state  vector. 

_[onal^_Techn  [gues  [117,260,267-272]  and 
Rei_[ab_i_lJ_t^_Es  t  j_mat  es 

An  estimate  of  the  initial  value  of  the  augmented 
state  vector,  z(0),  an  estimate  of  the  covariance  matrix, 
r  ( 0 )  ,  and  an  estimate  o  f  the  co  v  a  i  i  a  n  c  e  matrices  (7  and  R 
are  required  to  initiate  the  filter.  The  algorithm  is 
summarized  in  equations  (42)  and  (44).  Decomposition 
of  the  state  vector  has  been  studied  to  reduce  the 
computa t  iona 1  load  [273]. 

Calculation  of  the  covariance  matrix  of  the  augmented 
state  vector  is  inherent  in  the  algorithm.  However,  for 
the  extended  Kalman  filter  the  estimates  of  the  parameters 
are  biased  and  there  is  no  guarantee  that  _P(k)  will  con¬ 
verge  [117,260,274].  The  performance  of  the  Kalman  filter 
when  the  model  is  imperfect  and  the  noise  statistics 
poorly  defined  has  been  studied  [275,276]. 
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The  method  is  sequential  and  requires  the  solution  of 
equations  (42)  to  (44)  at  each  sample  time.  Therefore,  an 
on-line  process  computer  is  requ i red  to  implement  this 
scheme . 

[269] 

Application  of  the  technique  to  a  six-dimensional  non¬ 
linear  stirred  tank  reactor  is  related  by  Wells  [117]  in  an 
excellent  presentation.  Other  applications  include  a 
paper  machine  [118,119],  a  reactor  system  [116,277,278], 
orbit  parameter  estimation  [279]  and  guidance  [269]. 

5 o  COEFFICIENTS  IN  A  FUNCTIONAL  SERIES  EXPANSION 

Expansion  of  the  system  output  as  a  functional  power 
series  of  the  input  is  a  time-domain  technique  which  can  be 
applied  to  non-linear  systems  and  does  not  require  any 
a  p r  ior  ?  knowledge  of  the  structure  of  the  system. 

A 1 eksandrovsk  i  i  and  Deich  [10],  in  a  comprehensive  review 
of  the  1  iterature  on  methods  for  determining  the  dynamic 
cha racter  i  s t  i  cs  of  non-linear  systems,  conclude  that  the 
functional  power  series  representation  is  the  most  promising 
approach.  However,  as  normally  formulated  for  non-linear 
systems  this  approach  is  generally  poor  for  linear  systems  due 
to  the  non-linear  nature  of  the  component  functionals.  To 
date  this  technique  has  been  mostly  of  academic  interest  due 
to  the  large  compu tat iona 1  times  required. 
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It  should  be  emphasized  that  this  approach  simply 
produces  an  input-output  relationship  in  the  form  of  a 
series.  Transformation  of  the  results  into  an  alternative 
mathematical  representation  such  as  a  set  of  differential 
equations  or  mu  1 1 i -d imens iona 1  frequency  response  or 
transfer  functions  is  difficult  and  sometimes  impossible. 

The  synthesis  of  the  system  model  is,  in  practice,  not 
unique  since  many  systems  with  different  physical  configura¬ 
tion  can  exhibit  the  same  transmission  (input-output) 
character  ist  ics  .  Nevertheless,  the  resulting  explicit 
relationship  allows  the  system  output,  y(t),  to  be 
calculated  for  any  specified  input,  u(t),  and  is  useful 
in  simulation  studies  and  some  design  techniques. 


5 . 1  Volterra  Expansion 
Gene  ra  1__D  J_scuss|qn  [280-283] 

A  large  class  of  continuous,  non-linear,  time- 
variant  systems  can  be  represented  by  a  Volterra  series 
expans  ion  of  the  form: 


05) 


Equation  (45)  is  an  extension  to  non-1  inear  systems  of  the 
classical  convolution  integral  representation  of  linear 
systems  discussed  in  section  6.  In  the  general  case  the 
multi-variate  kernel  in  equation  (45)  reflects  the  dependence 
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of  the  transient  process  on  the  input  signal  amplitude 
and  the  past  state  of  the  system.  If  the  process  re¬ 
sponse ,  y ( t )  is  not  significantly  affected  by  the  inputs 
which  occurred  prior  to  some  time,  t  -  mT,the  process 
is  said  to  have  a  'finite  memory'  and  the  series  in 
equation  (45)  can  be  truncated  to  a  finite  number  of  terms, 
N.  Under  certain  conditions,  convergence  of  the  series 
is  assured  by  the  Freche  theorem  and  estimates  for  the 
convergence  of  the  series  can  be  obtained  [10,284"]. 

Solution  of  the  identification  problem  requires 
determination  of  the  kernels  g ^ ( t , t ^ )  .  .  .  gn ( t ,  t  .  .  .  ) 

in  equation  (45).  Methods  for  direct  calculation  of 
the  kernels  have  been  proposed  but,  the  more  common 
approach  is  to  approximate  the  kernels  by  an  expansion 
in  terms  of  orthogonal  functions,  such  as  the  following: 


N  N 

E  E 

n=0  m=0 


N 

E 

k=0 


(46) 


After  selection  of  a  suitable  set  of  orthogonal  functions 
the  identification  problem  is  reduced  to  the  determination 

of  the  parameters  a  which  in  general  cases  may  be 

functions  of  time.  A 1 exandrovsk  i  i  and  Deich  [10]  have 
reported  on  algorithms  for  the  statistical  determination 
of  these  coefficients  based  on  the  criterion  of  root-mean- 


square  error. 


H  •  m 


65 


The  integrations  in  equation  (45)  can  be  approximated 
by  an  equivalent  series  of  summations  to  produce  a 
discrete  or  sampled  data  formulation  of  the  same  technique 
Comput  at  |onal_Iechn_[gues  __[102_an  d_Re  l_|ab|l_  _[ty_Es  t  _[ma  tes 

Unfortunately,  the  technique,  inspite  of  the  simpli¬ 
city  of  the  concept,  results  in  a  large  number  of  coeffic¬ 
ients  which  must  be  estimated.  Proper  choice  of  the  or¬ 
thogonal  functions  and  the  input  signal  can  reduce  the 
dimensionality  of  the  estimation.  Current  methods  of 
solution  include  the  gradient-type  methods  [285-288], 
pattern-recognition  techniques  [289,290]  and  others 
[291-294].  In  theory  this  concept  can  be  implemented 
on-line  and  can  be  extended  to  mu  1 1  i -va r  iab 1 e  systems. 

E r]_i^me n  t  a  I _Ie  ch  n  J_c] u e  s  [295] 

The  input  to  the  system  is  arbitrary  and  the  form  of 
_u(t)  may  be  chosen  by  the  user.  However,  Wiener  [296]  has 
shown  that  the  optimum  test  signal  for  non-linear  system 
analysis  is  Gaussian  white  noise.  Many  of  the  binary  se¬ 
quences  [246,297]  provide  a  satisfactory  model  of  white 
noise  and  are  easier  and  more  convenient  to  implement. 
A|2l2l.i2§t  _[ons 

Kwatny  and  Shen  [298]  solve  two  numerical  examples. 
Lubbock  and  Barker  [288]  use  analogue  techniques  to  identi 
fy  a  heat  exchanger.  Katznelson  and  Gould  [291]  are 
partially  successful  in  applying  this  technique  to  char- 
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acterize  the  servo-mechanism  associated  with  the  pupil  of 
the  human  eye. 

5 . 2  Wiener  Theory 
G ene ral__D jscus s  jog  [9,281  ,299-303  ] 

Wiener's  method  consists,  essentially,  of  subjecting 
an  unknown  non-linear  system  to  a  Gaussian  white-noise 
input  and  calculating  the  cross-correlation  of  its  output 
with  non-linear  functions  of  its  input.  The  technique 
follows  directly  from  o rt hogona 1 i zat i on  of  the  Volterra 
expansion  (cf.  section  5-1)  [10]  and  is  covered  thoroughly 

by  Harris  and  Lapidus  [9]. 

The  method  is  limited  to  stable  systems  with  finite 
memory  and  the  physical  cha ract e r ? s t i cs  of  the  process 
are  not  considered.  The  result  is  simply  a  functional 
relationship  between  the  system  output  and  its  input. 

If  the  past  of  the  input  time  function  can  be  char¬ 
acterized  by  expansion  in  a  complete  set  of  orthonormal 
functions,  0.(t),  such  that 

u(t)  =  ”  c.0.(t)  (47) 

i  =0 

then  the  coefficients  of  the  functional  expansion,  Cj,  de¬ 
termine  u(t)  and  form  a  spectrum  by  which  the  analyzed 
function  can  be  identified.  Wiener  selected  a  Laguerre 


. 
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function  expansion  because  of  its  mathematical  properties 
and  the  fact  that  the  characterizing  coefficients  can 
be  generated  by  analogue  means. 

The  value  of  the  system  output,  y(t),  can  then  be  re¬ 
presented  by  an  arbitrary,  orthongonal  expansion  in  terms 
of  the  input  u(t).  However,  since  u(t)  can  be  character¬ 
ized  by  the  coefficients,  Cj,  of  equation  (47),  it  is 
possible  to  express  the  output  series  expansion  as  a 
function  of  Cj.  Selecting  Hermite  polynomials,  i|r  . ,  for 
the  expansion  because  they  are  orthogonal  with  respect 
to  a  white  Gaussian  process  permits  simplification  of  the 
expression  for  the  system  output  to  the  following  form 

[9]: 


The  coefficients,  a.  .  of  the  series  (48)  appear 

0  n 

linearly  and  because  of  the  orthogonal  nature  of  the  model 
can  be  evaluated  independently  and  have  the  important 
property  of  'finality1,  i.e.  y(t)  from  equation  (48)  can 
be  made  to  approximate  the  experimental  response  to  any 
degree  ‘of  accuracy  by  increasing  the  number  of  Laguerre 
coefficients  and  addition  of  the  ( n+ 1 )  Hermite  coeffici¬ 
ent  does  not  necessitate  re-eva 1 uat  i  ng  the  previously 
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determined  n  coefficients.  Practical  application  of 
Wiener's  method  is  limited  by  the  large  number  of  co¬ 
efficients  to  be  evaluated  and  the  sophisticated  (pre¬ 
ferably  hybrid)  computing  facilities  required  to 
analyse  the  results. 

CQHQli t at |ona]__Techn  j_gues  [9.,  10,304]  and_R el  ab [ ]_ _[ty 
Estimates 

In  practice  only  a  finite  number  of  coefficients  in 
the  functional  expansions  can  be  evaluated  and  error 
analysis  is  difficult.  The  extension  to  Wiener's 
method  by  Bose  [305~306]  leads  to  more  practical  imple¬ 
mentation.  Harris  and  Lapidus  [9*307]  and  Roy  et  al. 

[308]  apply  this  method  to  models  of  non-linear,  time- 
invariant  processes  with  switched  two-level  inputs  and 
finite  memo  r i es . 

E^Q^lifU^Qta^Technjgue 

A  Guassian  white-noise  test  signal,  or  one  of  its 
approximations,  is  applied  over  a  relatively  large  period 
of  time.  The  technique  is  off-line  in  practice  because 
it  is  convenient  to  use  the  recorded  data  of  u(t)  and  y(t) 
repeatedly  in  the  serial  evaluation  of  the  coefficients. 
ABIRliGsit  j_ons 

No  'physical'  applications  are  reported.  Harris  and 
Lapidus  [9*307*309]  use  digital  computer  simulation  to  apply 
the  method  to  a  stirred  tank  reactor.  Wilkie  [251]  compares 
this  method  with  several  other  techniques  for  application  to 
the  i dent i f  i  cat  ion  of  a  small  nuclear  reactor0 
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6.  IMPULSE  RESPONSE 

The  impulse  response  can  be  defined  as  the  response 
of  the  system  output  variable  to  a  Dirac  delta  function 
input,  i.e.  an  input  pulse  of  height,  h,  and  duration, 
1/h,  in  the  limit  as  h  tends  to  infinity.  However,  the 
impulse  response  is  seldom  found  by  such  direct  testing 
and  its  importance  lies  with  its  association  with  class¬ 
ical  Laplace  transform  analysis  and  because  the  response 
of  a  linear  system  to  any  arbitrary  forcing  function  can 
be  calculated  if  the  impulse  response  Is  known  (equations 
(50)  and  (51)) • 

For  t ime- inva r iant ,  linear  single  variable  systems 
the  input-output  relation  in  the  Laplace  domain, 
assuming  zero  initial  conditions,  is: 


Y ( s )  =  G ( s )  u(s)  (49) 

Formal  application  of  the  convolution  theorem  yields: 


y(t) 


T)u(T)  dT 


(50) 


Since  the  Laplace  transform  of  the  impulse  function  is  unity, 
it  follows  directly  that  the  impulse  response,  g(t),  can 
be  interpreted  as  either  the  inverse  Laplace  transform  of 
the  system  transfer  function,  G(s),  or  as  the  system  time 
domain  response  to  an  impulse  function. 
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For  linear  multi-variable  systems  with  zero  initial 
conditions  it  follows  from  equation  (3)  that 

l(t)  =  C  \  4>(t,T)  B(T)  u(T)  dT  (51) 

"0 

Therefore,  the  'impulse  response'  is  related  to  the  system 
transition  matrix,  _^>(t,T),  by: 


3(t  -  T)  =  ^(t,T)  B(t) 


(52) 


For  non-linear  systems  equat  ion  (45)  can  be  considered 
as  a  generalization  of  equation  (50). 

Since  it  is  impractical,  in  some  instances,  to  obtain 


the 


impuise  response  Oi  a  system 


U  i  I  C-  L 


iy , 


several  methods 


have  been  developed  to  calculate  it,  given  known  values  of 
the  input  and  output  variables  [310-311]. 


6 .  1  Direct  Impulse  Testing 
Genera7_D]_scuss]_on  [183,312,313] 

The  Dirac  delta  function  is  an  ideal  interrogation 
function  for  system  testing  because  it  has  a  uniform 
frequency  content  and  hence  will  excite  all  the  system 
modes . 

Comput  at  _[on_Iechn  j_gue_and_Rei  j  ab_[l_  j_t  y_E  s  t  ]_mates 

The  impulse  response  is  obtained  directly  by  curve 
fitting  an  assumed  process  model  to  the  observed  system 
response  [314].  The  accuracy  of  the  method  is  directly 
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dependent  on  how  closely  the  system  input  approximates 
an  ideal  impulse.  The  method  is  generally  more  accurate 
at  higher  frequencies  than  a  step  test  (cf.  section  2.5), 
but  is  sensitive  to  other  process  disturbances  and  noise. 
I^£?r jmen ta l__Techn jgue  [183,315] 

An  impulse  is  appl ied  to  the  system  input  and  the 
output  response  is  recorded.  However,  in  many  physical 
systems  it  is  impossible  to  generate  a  suitable  impulse 
in  the  input  variable  and  one  of  the  indirect  methods  of 
obtaining  the  impulse  response  must  be  used. 

Application  to  a  stirred  tank  reactor  is  reported 
[183*315]*  Tracer  studies  to  determine  the  degree  of 
mixing  in  a  system  are  analogous  to  this  technique  (see 
sect  ion  6.4). 

6 . 2  Deconvo 1 u t ion 

Gene ral__D j_scuss_[on  [5*312] 

For  many  systems,  given  records  of  the  system  inputs 
and  outputs,  it  is  possible  to  calculate  the  impulse  re¬ 
sponse  from  equation  (50)  or  (51)  by  'numerical  deconvolu¬ 
tion'.  The  data  must  be  relatively  noise-free  and  the  pro¬ 
cess  model  simple  if  the  computations  are  to  be  stable 
[316,317]. 


t  * 
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Q2lIi2y.tat_[ona  l__Techn_[gues_and_Re  J_[abJ_^J_ty;_Es  t  |mates 

Techniques  for  the  determination  of  the  kernel  in  an 
integral  equation  such  as  (50)  or  (51)  by  numerical 
deconvolution  have  been  reported  by  several  authors 
[312,318-322], 

Alternatively,,  in  a  manner  analogous  to  that  of 
section  5-1*  it  can  be  assumed  that  the  impulse  response 
can  be  sa t  i  s f acto r  i  1 y  approximated  by  an  infinite  series 
of  orthonormal  functions  and  the  coefficients  calculated 
from  the  experimental  data  [323-326]*  However,  a  large 
number  of  terms  is  often  required  for  sufficient  accuracy 
and  the  success  of  the  method  may  depend  on  proper 
choice  of  the  orthonormal  functions. 

Equation  (50)  can  also  be  converted  to  a  set  of 
linear  algebraic  equations  in  g  by  the  following  discrete 
app  rox  ima t  ion : 


y 


k 


u 


k-j 


(53) 


where  the  subscripts  define  the  time  interval  [220,327-330]. 
Solution  of  equation  (53)  produces  the  impulse  response  as 
a  discrete  time  series  which  can  be  used  directly  or  fitted 
with  a  suitable  model. 
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Experiment  a  l_Iechn  |gue 

The  method  does  not  require  any  particular  form  for 
the  test  signal  but  is  very  sensitive  to  noise  and  unmea¬ 
sured  disturbances. 

Applications 

This  technique  has  been  applied  to  the  i den t i f i cat  ion 
of  a  bo  i  1  er  [33 1  ]  • 

6.3  Correlation  Techniques 
Genera|_D  J_scuss  |on  [332-335] 

This  approach  is  attractive  because  arbitrary  or  random 
test  signals  can  be  used.  It  is  based  on  the  well-known 
Wiener-Hopf  equation  which  relates  the  cross-correlation 
function,  0Uy(t),  the  input  autoco  r  re  1  a  t  ion  function, 

0  (t),  and  the  impulse  response  function,  g(t): 

+  co 

0uy ( t)  =  [  g( T)  0uu(t  -  t)  dT  (54) 

—  CO 

where 


+  T 


+  T 

0uv(t)  =  Urn  [  u(t)y(t+T)  dx  (56) 

uy  j-»oo  j_7 
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The  convolution  integrals  in  equations  (54)  to  (56) 
are  time  consuming  to  evaluate  for  the  general  case  but 
can  be  simplified  considerably  by  proper  choice  of  the 
input  function,  u(t).  For  example,  the  autocor rel at  ion 
function  of  Gauss  ian  s  ignal s  approaches  a  delta  function 
so  that  equation  (54)  can  be  reduced  to: 

0uy(t)  =  Ag(t)  (57) 

where  A  is  the  root-mean-squa re  value  of  u(t). 

The  approach  has  been  extended  to  mu  1 1  i -va r  i ab 1 e 
systems  [336-339]  and  Briggs  et  al  .  [340]  discuss  the 
extension  to  non-linear  systems. 

Q2122 t a t hona  1  Techniques  [327,341-3451  and_Re b J_ t y_ 
Estimates  [345-353  1 

The  deconvolution  techniques  of  section  6.2  can  be 
applied  directly  to  equation  (54).  However,  if  a 
suitable  random  signal  is  used,  then  equations  (56)  and 
(57)  can  be  applied  and  the  calculation  is  simple,  direct 
and  less  sensitive  to  noise. 

Davies  [354]  describes  a  method  of  estimating  output 
drift  which  improves  the  accuracy  of  the  impulse  response, 
r  _f.rnen  t  a]__Technj_  gue 

A  broad-band,  random  test  signal  is  preferred  [355]- 
The  pseudo-random  binary  sequence  is  simpler  to  generate 
than  white  noise  (particularly  with  on-line  digital  com¬ 
puters)  and  allows  shorter  experimental  times  as  well  as 
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greater  accuracy  [348,356,357]. 

The  set-up  of  the  experimental  test  is  illustrated  in 
Figure  2.  Commercial,  special-purpose  instruments  are 
available  [358]  to  perform  the  analysis. 

Cummins  [359~360]  discusses  the  sources  of  errors  in 
determining  the  impulse  response  of  a  process. 

Matched  filters  have  also  been  used  in  this  context 
[361  ,362]. 

Godfrey  [363]  and  Briggs  et  al.  [340]  list  several 
applications.  Applications  include  an  evaporator  [364], 
a  pilot  scale  distillation  column  [365]*  a  diesel  engine 
[366],  a  heat  exchanger  [360,367]*  a  gas  ch romatograph 
[368],  a  nuclear  power  plant  [369]*  a  paper  machine  [370], 
a  thermal  process  [371]*  a  blast  furnace  [372],  a  cardio¬ 
vascular  system  [373]  and  a  control  system  with  time 
delays  [374]. 

Hill  and  McMurty  [375]  present  a  method  for  on-line 
impulse  response  identification  applied  to  several  numerical 
examp  1 es . 

6 . 4  Method  of  Moments 
6.2Q2!1^1_5  j.scus  s  j_on  [3761 

"The  transfer  function  for  any  stable,  linear,  one¬ 
dimensional  system  can  be  evaluated  from  experimental  re¬ 
sidence  time  distribution  data  obtained  by  the  use  of  the 
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FIGURE  2:  Identification  of  the  Impulse 
Response  Via  Correlation 

T echn  i ques 
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imperfect  pulse  method,  by  numerical  integration  of  the 
transient  response  to  an  arbitrary  forcing  function  mea¬ 
sured  at  two  locations  in  the  system"  [376].  The  tech¬ 
nique  is,  experimentally,  similar  to  pulse  testing  but  has 
been  most  widely  used  in  "tracer"  studies  to  determine 
parameters  in  mixing  models  for  flow  systems  [376-378]. 
Comput  at _[ona  l__Techn  j_gu es _an d_Re ]_ _[ab  J_ l__[t y^_E s  t  _[mat  es 

This  method  involves  calculating  weighted  moments  of 
the  experimental  data  and  equating  these  numeric  values 
to  appropriate  functions  of  the  Laplace  transform  of  the 
assumed  model,  G(s).  The  nth  moment  of  the  normalized 
experimental  response,  C(t),  can  be  calculated  from: 


CO 


exp(-st)  C(t)  tndt 


(58) 


o 


Moments  could  also  be  calculated  from  equation  (58)  using 
values  of  C(t)  calculated  from  the  assumed  model.  How¬ 
ever,  to  avoid  having  to  calculate  the  time  domain  solu¬ 
tion,  use  is  made  of  Laplace  transform  theory  to  show  that 


equation  (58)  is  defined  as  the  transform  of  tnC(t)  and 
that : 


Mn(s)  =  (-))n-^  C(s) 

dsr 


(59) 
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It  should  be  noted  that  if  the  input  forcing  function, 
C.(t),  is  a  pure  impulse  then  C  -  ( s )  =  1  and  Cq(s)  =  G(s). 
In  the  more  general  case  the  assumed  transfer  function 
model  is  related  to  the  transforms  of  the  system  input 
and  output  by  the  following  relationships: 


dmG  1  (  s ) 

dsmG ( s ) 


,m 


ds 


m 


C  1  (  s) 

C(s) 


0 


m  =  0,1,2,. 


(60) 


Thus,  in  practice  the  model  parameters  are  obtained  by 
solving  the  set  of  non-1  inear  algebraic  equations  that 
results  from  equations  (60).  The  transform  of  the  assumed 
model,  G(s),  is  substituted  into  the  left  hand  side  of 
equations  (60)  and  the  values  of  C(s)  and  its  derivatives 
which  arise  in  the  evaluation  of  the  right  hand  side  are 
replaced  by  numeric  values  calculated  from  the  experimental 
data  using  equation  (58). 

Michelsen  and  Ostergaard  [376]  present  four  methods 
of  calculating  the  model  parameters  from  the  moments  and 
show  that  the  sensitivity  to  experimental  errors  in  the 
transient  responses  can  be  greatly  reduced  by  proper  choice 
of  the  s  parameter. 

Mehta  and  Shemilt  [3771  work  with  moments  about  the 
origin  (equivalent  to  setting  s  =  0  in  the  above  equation) 
and  present  several  examples. 
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This  method  is  particularly  convenient  when  an 
app rop r  i  ate  mode  1  can  be  specified,  and  used,  directly 
in  the  Laplace  transform  domain.  Parameter  evaluation 
for  a  model  containing  p  parameters  requ  i  res  calculation 
of  at  least  p  moments.  If  the  experimental  data,  C  j ( t ) 
and  C  (t),  are  accurate  then  it  is  normally  advantageous 
to  calculate  more  than  p  moments  and  evaluate  the  para¬ 
meters  by  statistical  analysis  since  this  permits  evalua¬ 
tion  of  the  validity  of  the  model  [376].  The  transfer 
function,  G(s),  can  be  inverted  to  yield  the  impulse 
response,  g(t),  or  used  in  frequency  response  analysis 
as  discussed  in  section  7* 
r  hnen  t  a  l__Techn  j_gue 

The  input  mus t  be  a  c losed  pulse  and  the  output  must 
be  allowed  to  return  to  the  steady-state  value.  Truncating 
time  data  or  'drifting1  of  the  reference  base  can  cause 
serious  error  since  the  output  tail  is  weighted  heavily, 
especially  for  higher  moments. 

AQBli9§t  _[ons 

The  method  of  moments  has  been  appl  ied  to  the  model  1  ing 
of  liquid  fluidized  systems  [377],  the  evaluation  of  dis¬ 
persion  coefficients  for  fluid  flow  systems  [376,3791  and 
model  reduction  [380]. 
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7.  FREQUENCY  RESPONSE 

The  frequency  response  or  frequency  domain  model 
forms  the  basis  for  the  classical  design  and  analysis 
methods  of  s  i  ng 1 e~va r  i  ab 1 e ,  linear  control  systems.  It 
applies  to  systems  described  by  equation  (49)  and  is  nor¬ 
mally  presented  in  the  form  of  Bode  or  Nyquist  diagrams. 

The  frequency  response  of  a  system  can  be  calculated  from 
the  system  transfer  function  (G(s)  in  equation  (49))  or 
determined  by  experimental  tests  which  employ  periodic, 
aperiodic  or  random  signals.  It  can  be  shown  [381]  that 
if  a  'stable'  linear  system  is  subjected  to  a  sinusoidal 
forcing  function,  u(t)  =  umax  sin(uut),  the  output  (after 
the  initial  transient  has  died  out)  has  the  form 
y(t)  =  ymax  sin(uut  +  0)  and  that 

y  /u  I  G(  icu)  I  (61) 

'max  max  1  v  '  1  v  ' 

0  =  Z.  G  (  i  (ju)  (62) 

where  |  G  (  i  uu)  |  and  Z_  G  (  i  uu)  are  obtained  by  replacing  the 
Laplace  variable  in  the  system  transfer  function,  G(s), 
by  i  uu  and  formally  calculating  the  magnitude  and  angle  of 
the  resulting  complex  expression  [381]. 

The  utility  of  this  representation  lies  in  the  class¬ 
ical  design  and  analysis  techniques  that  have  been  developed 
for  direct  use  in  the  frequency  domain;  pure  time  delays 
can  be  easily  handled,  experimental  and/or  theoretical 
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frequency  response  plots  for  components  can  be  readily 
combined  into  an  overall  system  model,  and  the  stability 
of  feedback  control  systems  can  be  determined  from  the 
open-loop  model  without  having  to  invert  the  transforms 
or  perform  extensive  calculations. 

The  normal  procedure  associated  with  parameter  esti¬ 
mation  is  to  determine  the  frequency  response  from 
experimental  tests  and  then  fit  the  data  in  the  frequency 
domain  in  order  to  obtain  a  transfer  function  or  differ¬ 
ential  equation  model  [382-388].  Chen  and  Haas  [389] 
review  several  graphical  and  computer  methods  for  obtaining 
transfer  functions  and  include  computer  programme  listings 
for  Levy's  method  [390].  It  should  be  noted  that  a  'best1 
fit  in  the  frequency  domain  does  not  necessarily  yield  a 
‘best1  fit  in  the  time  domain.  The  time-domain  least- 
squares  criteria  can  be  transformed  analytically,  using 
Parseval's  theorem,  into  an  equivalent  expression  in  the 
frequency  domain  and  of  f  ers  d  ist  inct  advantages  [382,385, 
391,392]. 

A  series  of  twelve  articles  by  Murrill  et  al.  provide 
an  excellent  introduction  to  this  area  (e.g.  [393])-  A 
bibliography  of  early  applications  exists  [39^]* 

Describing  function  techniques  [395,398]  have  been 
used  in  an  attempt  to  extend  the  frequency  response  approach 
to  non-linear  systems. 
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The  frequency  response  approach  can  also  be  extended 
to  mu  1 1  i  va r  iab 1 e  linear  systems  by  using  matrices  of 
transfer  functions  but  in  practice  the  manipulation  of 
polynomials  in  the  Laplace  operator,  s,  becomes  difficult. 
Multivariate  frequency  response  based  on  time  series 
(spectral)  analysis  is  well  presented  by  Jenkins  and  Watts 
[385]*  They  show  that,  as  in  the  single  variable  case, 
spectral  analysis  and  frequency  response  estimation  re¬ 
present  extensions  of  correlation  and  multivariate  t ime- 
domain  techniques  to  the  frequency  domain. 

7. 1  Frequency  Response  Testing 
_[scus  s|on 

The  technique  is  well  documented  in  the  literature  [397., 
398]  and  textbooks  [387]  in  the  automatic  control  field. 

Compu  ta  t  j_ona2_Techn_[gues_and_R  e2iab_[7j_t  y_E  s  t  _?ma  t  es 

If  a  pure  sine  wave  is  used  as  a  forcing  function  then 
the  ratio  of  the  amplitudes  and  the  relative  phase  of 
the  input  and  output  signals,  as  defined  by  equations  (6l) 
and  (62),  give  one  point  on  a  frequency  response  plot 
[399].  Since  a  separate  test  must  be  run  for  each  point, 
the  method  is  time  consuming  and  is  better  applied  to  fast 
responding  linear  devices,  such  as  instruments,  than  to 
industrial  processes.  The  method  is  excellent  for  deter¬ 
mining  the  system  response  at  specific  frequencies  and  is 
relatively  insensitive  to  noise.  Signal  averaging  techni¬ 
ques  permit  valid  observations  at  very  low  signal-to- 
no  i  se  ratios. 
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Non-linearities  in  the  system  distort  the  output 
sinusoid  and  destroy  the  accuracy  of  the  test. 

I*  2  2  Li1!!  2  Qt  a  l__Iechn  j_que 

Generation  of  the  required  input  sinusoid  is  often 
difficult  or  impossible.  Commercial  instruments  are 
available  for  signal  generation  and  data  reduction.  Band¬ 
pass  filters  are  frequently  used  to  reduce  noise  and 
the  effect  of  harmonics  of  the  test  signal. 

Aqq! J_ca t  i_ons 

Reference  is  made  to  Pollock  and  Johnson  [397]  for 
their  treatment  using  a  small-scale  extraction  column. 

Other  applications  to  heat  exchange  equipment  [400-403], 
a  fluidized  bed  reactor  [404],  extraction  columns  [405], 
a  distillation  column  [4o6,407],  and  adsorption  column 
[408] ,  pneumatic  lines  [409]  and  a  respiratory  system 
[4l0]  are  reported. 

7 .2  Pulse  Testing 

Gene ral__D  hscuss_[on  [411-420] 

This  approach  is  based  on  the  definition  of  the  system 
transfer  function  as  the  ratio  of  the  transform  of  the 
output  function  divided  by  the  transform  of  the  input 
function.  If  a  'closed  form1  or  'pulse'  input  disturbance 
is  applied  to  a  linear  system  and  the  output  function  is 
recorded  then  application  of  the  Laplace  transform  and  the 
replacement  of  s  by  i  uu  yields: 
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G  (  ?  uu) 


v( 

u  (  i  uu) 


y(t)  exp(-iUJt)  dt 

'0 


\  u(  t)  exp(  —  i out )  dt 
0 


(63) 


Thus  if  the  transforms  can  be  found  the  frequency  re¬ 
sponse  follows  directly  from  equation  (63).  Since  a  pulse 
exhibits  a  continuous  frequency  spectrum  it  is  often 
possible,  by  proper  choice  of  the  input  signal,  to  extract 
the  frequency  response  over  the  full  range  of  interest 
f  rom  a  single  tes t  . 

CorDEyt  at  j_ona|  j[echnd  gues  _and_Re  l__[ab  jM _[t  y_Es  t  _imat  es 

Using  the  Euler  rel at  ionsh  ips  equat  ion  (63)  can  be 
separated  into  rea i  and  imaginary  parts: 


CD  ® 

^  y  ( t )  cos(  out)  dt  -  i  C  y(  t)s  in(cut)  dt 

G(!u.)  -  M ^ ^ - (6H) 

^  u(  t)  cos(  cut )  dt  -  i  j  u(t)sin(uut)  dt 

The  four  integrals  in  equation  (64)  must  be  evaluated 
for  the  duration  of  the  input  and  output  pulses  [415].  The 
following  numerical  techniques  have  been  used:  the  trape¬ 
zoidal  rule  [4 1 4 3 ,  F  Mon's  method  [4l4]  and  the  fast 
Fourier  transform  technique  [393 >42 1 , 422  ]  .  Errors  in  the 
analysis  arise  due  to  aliasing  [423]>  round-off  errors 
[424],  truncation  of  time  data  [4l8,425]>  frequency  content 
of  the  forcing  function  becoming  small  [426]  and  also  non- 
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linearities  in  the  process.  Comparisons  of  the  different 
computational  techniques  and  their  accuracy  have  been 
made  [414,426].  Lees  and  Dougherty  [424]  did  an  extensive 
amount  of  work  with  pulse  testing  and  showed  that  many  of 
the  problems  of  high-frequency  degeneration  are  due  to  the 
failure  of  the  numerical  approx imat ion  to  t he  Fourier 
integral  to  converge  and  that  the  upper  limit  in  frequency 
is  ujT  =  O.Itt.  They  also  recommend  about  ten  times  as 
many  experimental  points  than  are  taken  in  common  practice. 

In  a  later  article  Messa,  Luyben  and  Poehlein  [456]  indicate 
that  fewer  data  points  can  be  used  if  they  "adequately" 
define  the  pulse. 

E^D2rilZ,2Qt2l_4  52224 s 

The  effect  of  various  pulse  shapes  have  been  studied 
by  several  authors  [415, 4l8, 423*426,427],  but  many  shapes 
are  impractical  for  industrial  process  applications.  If  the 
input  variable  can  be  measured  accurately  the  input  pulse 
may  be  any  shape  (but  some  are  better  than  others)  and  thus 
be  generated  manually.  However,  the  input  and  output  shapes 
must  return  to  the  zero  position.  Truncating  the  data  can 
cause  problems  in  processes  which  exhibit  a  significant 
tail  [4 18] . 

Multiple  pulses  are  used  by  Pollock  and  Johnson  [397] 
to  increase  the  limiting  frequency.  Pulses  of  different 
areas  (power),  but  identical  shapes,  can  be  used  to  test 
system  1  inear  i ty . 
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AQBlicat  _ions 

Several  authors  [175,397,412,428]  compare  pulse 
testing  with  other  techniques.  Applications  include  a 
heat  exchanger  [423,426,429,430],  an  electric  furnace 
[175],  an  extraction  column  [397, 405, 4l 4 , 43 1  ] ,  flight 
control  [432],  a  distillation  column  [405,428],  mass 
transfer  in  a  fluid  flow  system  [433],  a  control  system 
[434],  a  partially  mixed  stirred  tank  reactor  [435]  and 
a  wetted  wall  column  [427]. 

7.3  Frequency  Response  Data  from  Transient  Response 

G enera l__D_[scus s j_on  [397,436] 

A  step  function  is  a  convenient  test  signal  because 
it  is  easy  to  generate  and  response  data  are  often  ava  i  1 - 
able  from  normal  operating  records.  The  ca 1 cu 1  at  iona 1 
methods  applied  in  the  previous  section  cannot  be  used 
directly  since  the  Fourier  transform  of  a  step  function  is 
not  defined.  One  solution  to  this  difficulty  is  to 
differentiate  the  input  and  output  functions,  apply  the 
definition  of  the  Laplace  transform  to  the  derivatives 
and  then  integrate  by  parts  to  yield: 


■ 


(65) 


G  ( s) 


exp( -sT2) y ( T  2 ) +  s  y( t)exp( -st) dt 


exp(  -sT  ^ )  u( T  ^ )  +  s  C  ^  u(  t)  exp( -st)  dt 

Jo 


Replacement  of  s  by  i  uj  permits  calculation  of  the  frequency 
response . 

If  it  is  desired  to  obtain  a  time-domain  model  from 
experimental  step  response  data  then  the  methods  of  section 
2.5  should  be  considered  instead  of  finding  the  frequency 
response  and  then  curve  fitting. 

Computational  Techniques  [397*436]  and_Re liabqiqt y  Estimates 

Applicable  techniques  include  Fourier  or  Laplace 
transforms  [397]  and  graphical  techniques  [437-438]. 

Strobel  [439]  and  Unbehauen  and  Sch  legel  [440  ]  study 
the  effect  of  errors  in  the  time  domain  on  the  frequency 
response  data. 

E^qer imen tai_Technigue 

A  step  test  is  normally  used  [397].  However,  Petrovic 
[44 1  1  considers  seven  other  test  signals. 

ARQlicat iqns 

Applications  involving  a  distillation  column  [391]* 
and  an  extraction  column  [397]  are  reported.  Pollock  and 
Johnson  [397]  conclude  this  method  is  as  accurate  as 
pulse  testing  for  their  system. 


88 


7 . 4  Frequency  Response  from  Spectral  Analysis 
General__D_[scuss  _i_qn  [385] 

The  Wiener-Hopf  equation  was  used  in  section  6.3 
obtain  the  system  impulse  response  from  the  auto  and 
correlation  functions  of  the  system  input  and  output 
variables,  i  . e . 

-f-  CO 

‘W1  -  T)  dT 

—  CO 

Application  of  the  Fourier  transform  to  equation  (54) 
y  i  e  1  ds : 

$uyH  =  G(tu)  ?uu(ai) 

where 

$uU((JU)  =  spectral  density  function  calculated 
taking  the  Fourier  transform  of  the 
cross-correlation  function  defined  by 
equat  ion  ( 55) , 

«UUW  =  spectral  density  function  calculated 
taking  the  Fourier  transform  of  the 
autocorrelation  function  defined  by 
equat  ion  ( 56) , 

G(w)  =  system  frequency  response. 


to 

cross- 

(54) 

( 66) 

by 

by 
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The  power  spectral  density  functions  have  physical  meaning 
as  a  measure  of  the  power  content  of  a  signal  as  a 
function  of  frequency.  Methods  of  generating  random  test 
signals  with  a  particular  power  density  spectrum  have  been 
reported  [442].  This  technique  is  of  particular  value 
when  system  response  data  for  'random'  inputs  are  already 
available.  However,  long  data  records  (often  several 
thousand  points)  are  frequently  required  to  produce  the 
des i red  accu racy . 

Computational  Technique  and  Reliability  Estimates 

[385,393,512,  W3-W9] 

One  comp utat iona 1  approach  is  to  evalute  the  convolu¬ 
tion  integrals  which  define  the  spectral  density  functions 
and  then  to  evaluate  G(cu)  from  equation  (66).  This  rather 
complicated  dat a-p roces s i ng  technique  tends  to  be  in¬ 
accurate  unless  special  techniques  such  as  the  use  of 
'spectral  windows'  are  used  to  smooth  the  estimates,  remove 
the  effect  of  output  drift  and  of  data  truncation  [385]- 

The  reader  should  consult  references  such  as  Jenkins 
and  Watts  [385]  before  using  these  techniques.  They 
discuss  the  importance  of  considering  the  statistical 
properties  of  the  estimators,  the  implication  of  correla¬ 
tion  between  the  various  signals,  the  relative  advantages 
of  different  calculations  approaches  and  the  relationship 
to  familiar  1  east-squares  techniques. 


■ ' 
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The  degree  of  causality  (dependence)  of  an  output 
y(t)  on  the  input  u(t)  vs.  unrelated  process  noise  n(t) 
can  be  defined  by  calculation  of  a  coherence  function 
[385*450].  The  effects  of  the  noise  can  be  reduced  by 
proper  averaging  techniques  if  replicate  runs  are 
ava  i  1 ab 1 e  . 

Confidence  limits  for  the  estimates  of  the  phase  and 
gain  at  each  point  can  be  calculated  [385 *  444,  447]  . 
al_Iechn  _[gue 

The  forcing  function  is  normally  a  random  signal.  It 
can  be  the  normal  process  operating  record  [316],  pseudo¬ 
random  binary  chain  code  [246]  or  random  telegraph 
signal  [444].  These  test  signals  are  easily  applied. 

The  test  is  not  sensitive  to  other  disturbances. 

Hutchinson  and  Shelton  [444]  apply  this  scheme  to  an 
oil-refinery  depropanizer  column  in  an  excellent  treatment 
of  the  method.  Comparison  of  this  method  with  other 
testing  procedures  is  considered  in  [175]  and  [412].  The 
method  has  been  applied  to  identification  of  heat  ex¬ 
changers  [451  ]  ^reactor  systems  [452-454]  and  packed  towers 

[455]- 
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8.  CONCLUS  IONS 

It  is  obvious  from  this  review  and  previous  ones  that 
there  are  a  great  many  different  methods  for  process 
ident  i  f  icat  ion  and  parameter  estimation  and  an  abundance 
of  literature  dealing  with  their  development  and  applica¬ 
tion.  The  author  feels  that  in  addition  to  further  work 
on  individual  methods  there  is  a  need  for  comparative 
studies  and  increased  emphasis  on  applications.  Discussion 
of  reliability  estimates,  relationship  to  other  methods, 
effects  of  noise,  practical  aspects  of  implementation, 
etc.  would  make  many  p resentat  ions  more  complete,  and  the 
use  of  'standardized'  examples  would  facilitate  direct 
comparison  of  methods.  This  paper  is  intended  as  another 
step  in  this  direction  and  to  assist  the  reader  in  selecting' 
a  method  for  his  particular  area  of  interest. 


. 
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CHAPTER  THREE 

PARAMETER  ESTIMATION  USING  QU AS  I  L  I N E AR  I  ZAT  I  ON 


ABSTRACT 


A  general  ized  approach  to  process  i den t  i  f i cat  ion  is 
developed  in  this  chapter.  The  algorithm,  which  combines 
linear  programming  with  quas  i  1  i  nea r  iza t  ion ,  is  formulated 
and  many  of  the  practical  aspects  of  its  implementation, 
including  computation  and  convergence,  are  explored. 

Examples  are  presented  to  illustrate  application  of 
the  algorithm  to  real  engineering  problems,  to  demonstrate 
the  incorporation  of  constraints  and  to  introduce  a  tech¬ 
nique  for  extending  the  region  of  convergence  of  the 
a  1  go  r i thm . 
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1  .  INTRODUCT  ION 

One  of  the  most  common  problems  in  engineering  analy¬ 
sis  is  the  determination  of  parameters  in  a  mathematical 
model  such  that  the  model  response  sat  i  sf actor  i  1 y  repro¬ 
duces  or  "best"  fits  experimental  data  taken  from  the 
physical  system  of  interest. 

A  convenient  rep resentat  ion  for  the  mathematical  model 
of  many  dynamic  systems  is  the  vector  differential  equation: 


x(t)  =  1  [x(t)  ,  u(t)  ,  £(t)]  (1) 

x(t)  =  h  [x(  t)  ,  u(  t)  ,  w(  t)  ]  (2) 

where 

x(t)  =  state  vector  (n  x  1) 

_u(t)  =  input  or  control  vector  (m  x  1) 

j)(t)  =  unknown  parameters  vector  (p  x  1) 

_y_(t)  =  output  vector  (r  x  1) 

w(t)  =  measurement  noise  (r  x  1) 


The  parameter  estimation  problem  is  to  determine  jq(t) 
such  that  the  model  optimizes  a  specified  objective  function 
such  as  minimizing  the  sum  of  the  differences  between  the 
model  response  and  the  discrete  experimental  data  points. 
There  are  many  techniques  available  for  the  solution  of  this 
inverse  problem  [1]  but  one  of  the  most  general  and  powerful 
approaches  is  to  transform  the  parameter  identification  pro¬ 
blem  into  a  boundary  value  problem.  This  transformation  can 


9^ 


be  made  by  defining  z_(t)  to  be  the  augmented  state 
var  iab 1 e: 


z(t) 


(3) 


and 


(4) 


0 


since  for  the  time  invariant  model  £(t)  =  jd.  In  terms  of 
the  augmented  state  vector  equations  (1)  and  (2)  become: 


z(t)  =  S  [z(t),  u(t)  ] 


(5) 


y(t)  =  h  [z(t)  ,  u(t)  ]  +  w(t) 


(6) 


The  parameter  estimation  problem  may  now  be  stated  as 
one  of  determining  part  or  all  of  the  initial  conditions 
of  the  state  vector  such  that  an  index  of  performance  is 
minimized.  The  index  of  performance  is  usually  some  function 
of  the  residuals  which  are  defined  as  the  difference  between 
observed  values  and  those  predicted  by  equations  (5)  and  (6). 
Thus  a  boundary  value  problem  similar  to  that  which  arises 
in  optimal  control  theory  must  be  solved. 

There  are  many  computat ional  approaches  to  this  boundary 
value  problem  [2],  however,  one  of  the  most  promising  is 
quasil  inearization  which  was  selected  for  this  work  on  that 
basis  as  well  as  the  fact  that  previous  work  had  been  done 


■ 
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on  quas  i  1  inear  izat  ion  as  a  numerical  method  in  the  depart¬ 
ment  [3].  The  desire  to  be  able  to  incorporate  as  much  a 
priori  knowledge  of  the  system  as  possible  into  the  problem 
solution  as  well  as  the  need  to  alleviate  ill  conditioning 
problems  led  to  the  use  of  linear  programming  in  the  al¬ 
gorithm  presented  in  this  work. 

Other  authors  have  used  quas  i  1  i nea r  i zat  ion  for  para¬ 
meter  estimation  problems  [2 , 3 > ^ > 5 , 6 , 7  ]  and  developed  the 
theoretical  basis  for  the  approach.  This  work  is  concerned 
primarily  with  the  following  practical  aspects  which  are 
required  for  a  useful,  generalized  algorithm: 

(1)  formulation  and  computational  aspects 

(2)  use  of  different  linear  performance  indices 

(3)  incorporat  ion  of  contraints  on  the  parameters 
and/or  state  variables 

(4)  generating  reliability  estimates  of  parameters 

(5)  extending  the  region  of  convergence  of  the  quasi¬ 
linearization  algorithm. 

Four  examples  are  presented  to  illustrate  the  application 
of  the  quas  i  1  inear  izat  ion  plus  linear  programming  algorithm 
developed  in  this  work  and  include  experimental  evaluation 
of  the  derived  models. 
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2  .  FORMULATION  AND  THEORY  OF  QUAS  IL  INEAR  I  ZAT ION 

The  quas i 1  inear izat ion  approach  treats  the  nonlinear 

boundary  value  problem  as  a  series  of  linear  problems 

which  hopefully  converge  to  a  feasible  solution  [3,8]. 

Expanding  the  right-hand  side  of  equation  (5)  in  a 

first  order  Taylor  series  the  value  of  the  right-hand-side 

s  t 

vector  at  the  (m  +  1)  iteration  may  be  calculated  in 
terms  of  the  previous  iteration: 


(m+l) 


=  a 


( m )  +  jM 


(m+l)  _  (m) 


(7) 


where  the  arguments  of  the  functions  have  been  dropped  for 
clarity.  The  matrix  is  the  Jacobian  matrix  the  ele¬ 

ments  of  which  are  defined  as: 


a 


a 


The  linearized  version  of  equation  (5)  becomes: 


Ani+,)(t) 


j(nn)  2(m+l)(t)  + 


(9) 


Application  of  the  principle  of  superposition  [91  leads  to 
the  well  known  solution  in  terms  of  the  sum  of  a  homogeneous 
and  a  particular  solution,  z  (t). 

r 


. 
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z(m+')(t)  .  0(m+,)t)z(m+1)(O)  +  z(m+')(t)  (10) 

\  /  P 

The  matrix  0  is  the  fundamental  or  transition  matrix  which 
itself  is  a  solution  to  an  ordinary  differential  equation 
with  initial  conditions  0(0)  =  J_.  Since  the  unknown 
parameters  are  included  in  z_(0),  equat  ions*(  1 0)  serve  as 
constraint  equations  during  the  minimization  of  the  perfor¬ 
mance  index.  Conventional  least  squares  is  a  convenient 
method  for  estimating  _z(0)  from  equation  (10)  and  the  tra¬ 
jectory  data  [3,4,5]-  However,  this  approach  is  often 
hindered  by  ill-conditioned  linear  equations.  Linear  pro¬ 
gramming  techniques  offer  a  viable  alternative. 

Figure  1  is  a  simplified  flowsheet  depicting  the  main 
modules  in  the  algorithm  as  set  up  for  computer  implementa¬ 
tion.  Based  on  an  initial  guess  of  the  unknown  parameters 
which  form  all,  or  part,  of  the  vector  z.(0)  the  particular 
solution  in  equation  (10)  is  generated  by  standard  fourth 
order  Runge  Kutta  integration.  The  fundamental  matrix 
0(t)  is  generated  in  a  like  manner.  A  new  parameter  vector, 
^(m+1)(0)  is  chosen  by  standard  linear  programming  techni¬ 
ques  so  as  to  minimize  the  index  of  performance  which  is  a 
linear  function  of  the  difference  between  the  model  response 
represented  by  equat  ion  (10)  and  the  experimental  data.  When 
the  current  values  of  the  parameters  vector  differ  by  an 
arbitrarily  small  factor  from  the  previous  values,  the 


i  ftj  stfli  un\  7>  m  %  A  ..  .  ii 
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FIGURE  1:  Flow  Diagram  of  Parameter  Estimation  Algorithm 


99 


algorithm  has  converged,  if  the  parameters  have  not  been 
artificially  constrained  so  as  to  promote  convergence,  the 
solution  is  complete.  The  convergence  promotion  will  be 
discussed  subsequently. 


3 .  COMPUTAT  ION AL  ASPFCTS 

If  the  quas  i  1  i  nea r  i  zat  ion  algorithm  described  above 

were  to  be  applied  directly,  a  massive  computational  effort 

p 

would  be  required  to  numerically  integrate  (N^*n  +  P)  + 
(^DS*n  +  p)  differential  equations  where  is  the  number 

of  data  sets  and  n  and  p  are  the  dimensions  of  the  state 
and  parameter  vectors  respectively.  Donnelly  and  Quon  [4] 
took  advantage  of  the  structure  of  the  problem  which  re¬ 
sults  from  independent  experiments  and  the  fact  that 

in  many  problems  the  initial  conditions  of  all  the  state 
va  r  i  ab  1  es  _x(  0)  are  known.  These  simplifications  meant  the 
number  of  differential  equations  which  had  to  be  integrated 
at  each  iteration  was  reduced  to  (N^*n  +  N^‘n*P)* 

With  these  modifications  equation  (10)  can  be  expressed 
in  the  following  form: 

Am+,4t)  -  G^+1)(t)  £(m+1) .  ♦  v(m+1)(t)  ())) 


where  v  (t)  is  the  particular  solution  starting  with  known 


initial  conditions  and  G 


(m+1) 

-Pi 


is  the  fundamental  matrix 


associated  with  the  unknown  parameters,  jd.  The  subscript  j 


has  been  added  to  indicate  multiple  data  sets. 


100 


Example  4  below  will  demonstrate  that  with  minor  ad¬ 
justments  to  the  problem  formulation  the  algorithm  can  be 
applied  directly  even  where  some  of  the  initial  conditions 
are  not  known . 

Ramaker  et  al  [5]  report  that  calculation  of  the  change 
in  parameter  estimates  removes  the  necessity  of  generating 
the  particular  solution  (i.e.  on  1  y  (N  ^c.  .  n  .  p )  equations  need 
be  integrated).  These  authors  also  outline  means  of  mini¬ 
mizing  core  storage  requirements  at  the  expense  of  computer 
runn  i ng  t  imes . 

The  greatest  potential  for  improvement  in  computat ional 
time  can  be  achieved  in  the  numerical  integration  step. 

The  algorithm  reported  in  this  work  employs  a  fourth  order 
Runge  Kutta  procedure.  The  more  soph i s toca t ed  predictor- 
corrector  methods  are  more  efficient  and  could  be  substituted 
directly.  Ramaker  et  al  [5]  report  successful  use  of  the 
rectangular  integration  method  in  the  quas  i  1  inea r  i  zat  ion 
method . 

In  order  to  reduce  storage  requirements  the  latest 
t  h 

(i.e.  m  )  trajectory  was  not  stored  but  rather  the  previous 
(m  )  trajectories  were  regenerated  at  the  (m+1)  iteration. 
Generating  the  previous  solution  directly  from  the  nonlinear 
model  (equation  (5))  as  reported  by  Ramaker  et  al  [5]  would 
have  resulted  in  a  considerable  saving  of  computational 


effort. 


The  most  computational  effort  is  expended  in  generation 
of  the  fundamental  matrix,  0,  in  equation  (10).  An  alter¬ 
native  method  of  generating  this  matrix  is  by  sensitivity 
methods  which  requires  perturbation  of  the  initial  condi¬ 
tions  and  generation  of  the  final  conditions  from  the  non¬ 
linear  model.  The  fundamental  matrix  can  then  be  calcu¬ 
lated  from: 

Az(m)(0)  =  -  (0~V"1'1  Az(t.f)  (12) 

As  indicated  by  equation  (8)  partial  derivatives  are 
required  in  the  quas  i  1  i  nea r  i  za t  ion  solution.  Analytical 
expressions  were  derived  in  this  work;  however  this  Is 
a  lcu  ioua  cask  ro i  even  a  problem  of  modest  dimensions. 
Finite  difference  techniques  are  an  attractive  alternative. 
Surkan  and  Wu  [10]  make  reference  to  a  very  convenient 
formula  manipulation  language  which  they  use  to  generate 
partial  derivatives  in  symbolic  form. 

As  indicated  in  equations  (3)  and  (4)  this  formulation 
required  the  assumption  of  constant  parameters.  Lee  [11] 
presents  a  very  simple  technique  for  relaxing  this  require¬ 
ment  by  assuming  the  functional  form  of  j}(t)  to  be: 

£(t)  =  £(a»t)  (13) 

and  the  constants,  _a ,  become  the  constant  parameters  which 
must  be  determined. 


' 
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4.  L  INEAR  EST  MAT  ION 

The  main  difficulty  with  the  quas i  1  inear  i  zat  ion  method 
arises  from  the  fact  that  in  using  the  superposition 
principle  a  set  of  linear  equations  must  be  solved.  The 
linear  equations  arise  from  the  minimization  of  the  perfor¬ 
mance  index  with  equation  (10)  representing  the  model  tra¬ 
jectory.  I  1 1 -cond i t ion Ing  can  therefore  render  the  least 
squares  approach  useless  [12].  Through  use  of  the 
Chebyshev  criterion  or  the  sum-of-abso 1 ute-er ror  (SAE) 
criterion,  linear  programming  techniques  can  be  used  and 

the  problems  with  i 1 1 -cond  i  t ion ing  are  reduced  [13].  Several 
other  advantages  arise  from  the  use  of  these  criteria  in 
conjunction  with  linear  programming: 

(1)  the  facility  with  which  hard,  soft  or  target 
type  constraints  are  incorporated  into  the 
problem  solution  [14] 

(2)  larger  sets  of  linear  equations  can  be  solved 
using  these  techniques  [13] 

(3)  because  more  a  priori  knowledge  can  be  incor¬ 
porated  into  the  problem  solution  greater 
stability  is  usually  ensured 

(4)  "better"  estimates  have  been  reported  from  the 
Chebyshev  criterion  than  least  squares  [6,7] 

in  certain  situations. 

However  disadvantages  of  this  approach  are  also  evident: 


.  • 


. 


. 
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(1)  the  estimation  is  an  iterative  procedure  when 
linear  programming  is  used  [15]  whereas  the 
least  squares  problem  has  a  closed  form  solution 
in  the  form  of  the  well  known  "normal" 

equat ions 

(2)  as  is  the  case  with  least  squares  the  constraint 
equations  must  be  linear  with  respect  to  the 
parameters 

(3)  the  linear  programming  algorithm  has  a  tendency 
to  hunt  for  an  optimum  which  only  improves  the 
solution  minutely  [16] 

(4)  unlike  least  squares  which  results  in  est  imates 
which  have  many  of  the  decirable  statistical 
properties  of  an  estimator  [17]  (efficient, 
unbiased  and  identical  to  maximum  likelihood 
estimators  for  systems  with  Gaussian  noise)  the 
Chebyshev  and  SAE  criteria  produce  estimates 
which  are  only  consistent  [18]. 

The  least  squares  formulation  has  been  reported  else¬ 
where  [4,12,19]  and  will  not  be  repeated  here.  However,  the 
Chebyshev  and  SAE  criteria  will  be  formulated  in  considerable 
detail.  In  the  subsequent  sections  it  is  assumed  that  the 
output  vector  y(t)  (r  x  1)  is  simply  a  subset  of  the  state 

vector,  x(t)  (n  x  1).  x;ji<  denote  value  of  the  i^ 

t  h 

state  variable  of  the  j  data  set  at  time,  t^. 
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4 . 1  Chebyshev  Criterion 

The  Chebyshev  criterion  is  simply  minimization  of  the 
maximum  difference  between  the  calculated  (from  equation 
(10))  and  the  observed,  _y_(t),  values.  The  maximum  deviation, 
X  ,  is  def i ned  to  be: 


X 


f  rom  wh  i  ch 


x  . 


-  y 


JJ< 


s  .  . . 

1 J  K 


i  = 


f  o  r  a  1  1  j 
k 


1,  2, 

1,  2, 

1,  2, 


DS 


(14) 


Nj 


x..,  +  s..,  X  ^  y . 
ijk  i jk  A  y  i jk 


i  j  k  i  j  k  y  i  j  k 


i  =  1 ,2 , .  .  .  ,  r 
for  all  j  =  1  ,2 ,  .  . . 

k  =  1  , 2 ,  .  .  .  ,  N  j 


(15) 


t  h 

where  s  .  j } ,  is  a  weighting  factor  assigned  to  the  i  state 
variable  in  the  j^data  set  at  time  t(<  .  Substituting 
equation  (11)  into  equation  (15),  the  following  matrix 
equations  can  be  formed: 


£pj(t)  £  +  5j(t)  X  &  Xj(t)  -  Vj(t) 

( 16) 

-  Gpj.(t)  £  +  lj(t)  A  a-^j(t)  +  Vj(t) 

Formulating  the  linear  estimation  problem  as  a  linear  pro¬ 
gramming  problem,  the  object  is  to  minimize  the  linear  ob¬ 
jective  function,  X,  subject  to  the  linear  constraints  formed 
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from  equations  (16).  If  constraints  on  jd  can  be  expressed 
as : 


V  a  £p  (17) 

and  hard  constraints  on  x(t)  can  be  expressed  as: 

G^j(t)  .  £  *  Cx(t)  -  Vj(t)  (18) 

the  complete  LP  problem  can  be  summarized  by: 


minimize:  z  =  X 

subject  to: 


G  ■  (  t.  )  i  s  .  t, 

-pjv  k'  i  ~_p  kJ 

i 

^•(k)  -  * 

-5pj(tk)  |  sj(tk) 

~  £ 

♦  •  ®  •  » 

X 

> 

•M 

• — 1 
>1 

+ 

4-1 

- ) 

V 

G'p(tk)  |  0 

1 

o| 

Q. 

<1 

- 1 

c 

L  -p  J 

where  k  and  j  vary  over  all  possible  values  as  per  equation 
(15). 

Equation  (19)  has  (2r(E  N-)  +  p  +  n  (E  N-))  rows  and 

j  J  j  J 

(p  +  1)  columns.  Since  the  number  of  iterations  taken  to 
solve  a  linear  programming  problem  is  proportional  to  the 
number  of  rows  only,  the  dual  problem  to  that  summarized 
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in  equation  (19)  results  in  greater  computational  effic¬ 
iency  [15].  The  number  of  iterations  is  dependent  only 
on  the  number  of  unknown  parameters  and  is  independent  of 
the  number  of  state  variables  and  data  points. 

Caution  must  be  taken  when  using  this  fitting  criterion 
since  poor  data  points  can  render  the  est  irnat  ion  useless. 
However  careful  examination  of  the  "controlling"  data 
points  can  often  result  in  the  location  of  data  points  with 
gross  errors  [20], 

Note  that  constraints  on  the  state  variables  are 
forced  only  at  sampling  instants. 

4 . 2  Sum  of  the  Absolute  Errors  (SAE) 

Another  linear  criterion  can  be  defined  as  the  sum  of 
the  absolute  deviations  between  the  model  response  and  the 
experimental  data: 


(20) 


Z 


i  j  k  y  i  j  k 


In  a  form  which  is  more  convenient  for  linear  programming 
t echn  i ques : 


Z 


e  1 


ijk 


ijk 


(21) 


j=l  k=l  i= 1 


where 
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and 


x  .  . ,  -  y  .  . , 

ijk  y  ijk 


> 


0, 


^  0 


(22) 


The  linear  programming  problem  the  becomes:  minimize  the 
objective  function,  Z,  as  defined  by  equation  (21)  subject 
to  (from  equation  (11)): 


Gpj(tk)  £  +  £lj(tk)  -  l2j(tk)  =  ij(tk)  -  Vj(tk)  (23) 

for  all  j  and  k.  Constraints  on  the  state  and  parameter 

vector  can  be  appended  to  equation  (23)  in  a  similar  manner 

to  that  outlined  above  for  equation  (19)-  However,  this 

formulation  results  in  r(£  N-)  rows  and  r  +  2r(£  N-)  columns 

j  J  J 

( d i s rega r d  ing  constraints)  which  indicates  the  primal  solu¬ 
tion  is  more  efficient.  In  this  case,  therefore,  the  number 
of  linear  programming  iterations  is  dependent  upon  the 
number  of  state  variables  and  data  points.  Obviously  the 
SAE  criterion  is  less  attractive  than  the  Chebyshev  criterion 
from  a  computational  point  of  view. 
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5  •  PREDICTION  OF  THE  RELIABILITY  OF  PARAMETERS 
AND  ACCURACY  OF  THE  MODEL 

A  factor  often  overlooked  in  the  estimation  of  para¬ 
meters  is  the  estimate  of  the  reliability  of  the  parameters. 
The  estimates  of  the  validity  of  the  parameters  can  be  use- 

i 

ful  in  the  design  of  subsequent  experiments  so  as  to  obtain 
data  which  facilitate  complete  and  accurate  model  deter¬ 
mination.  Therefore,  it  is  not  always  as  important  to 
obtain  accurate  estimates  of  the  elements  in  the  covariance 
matrix  for  the  parameters  as  it  is  to  determine  which 
estimates  are  in  doubt. 

The  sensitivity  matrix,  G_  .(t),  required  in  reliability 

P  J 

estimation  is  inherent  in  the  quas  i  1  i  nea r  i  zat  ion  algorithm. 
Heinekcn  et  al  [21]  end  Seinfeld  and  Gavalas  [19]  spply 
quas  i  1  i  near  izat  ion  with  the  reliability  analysis  developed 
by  Rosenbrock  and  Storey  [22]  for  the  least  squares 
criterion. 

A  similar  analysis  is  applicable  when  linear  programming 
techniques  are  used.  In  general  a  linear  programming  pro¬ 
blem  may  be  expressed  as: 


T 

min:  Z  =  c  x 


subject  to:  Ax.  ^  Jb 


(24) 

(25) 


The  basis  matrix,  B_,  determines  the  basic  solution  to  the 
linear  programming  problem: 


109 


B 


b 


(26) 


where  it  is  implicity  understood  that  all  variables  not 
associated  with  the  columns  of  A  appearing  in  B_  are  zero. 
Corresponding  to  any  Xg  ,  a  vector  _c^  is  defined  3  the 
elements  of  which  are  the  coefficients  in  equat  ion  (24) 
associated  with  the  basic  variables  (elements  of  x^)  . 

The  dual  variables  of  the  linear  programming  problem  of 
equation  (25)  are  derived  from: 


(b^v  cB 


(27) 


Neglecting  for  the  moment  constraints  on  the  para¬ 
meters  and  states,  the  dual  formulation  to  the  linear 
programming  problem  of  equation  (19)  becomes: 


max im  i  ze:  Z 1 


(28) 


subject  to:  _A  uj  ^  _b 


6 


A 


where 


■ 


T 

for  al  1  k,  j  and  b  =  [0  0  ...  1  ].  Si  nee  ( t )  is  the  only 

vector  which  is  subject  to  random  error,  the  covariance 
matrix  of  the  dual  variables  to  the  problem  of  equation 
(28)  is: 

C  (yB)  =  (B-y  V(S)  (!"')  (29) 

where  yjg  =  [£  :  \]  since  the  dual  of  the  dual  is  the  primal. 

F  rom  the  definition  of  V_(_6)  is  equal1  to  V_(y)  .  Usually 
the  covariance  matrix  of  the  measured  values  is  not  known 
more  accurately  than 

v  Wt)l  =  O2  1  (30) 

Equation  (29)  forms  the  basis  for  the  reliability  estimates 
derived  from  the  Chebyshev  criterion.  A  similar  analysis 
is  applicable  for  the  SAE  criterion.  Recall  that  _B  ^  is 
obtained  directly  from  the  revised  simplex  algorithm. 

The  diagonal  elements  of  C_(ui)g)  are  the  variance  estimates 
of  the  corresponding  elements  of  jijg  .  The  off  diagonal  ele¬ 
ments  are  covariance  estimates  and  they  indicate  the  inter¬ 
action  between  parameters.  Statistically  independent  para¬ 
meters.  have  a  covariance  of  zero. 

The  variance  estimates  reported  in  this  work  are 
consistent  with  those  reported  by  Babbar  [23]* 


6 .  PROMOTION  OF  CONVERGENCE 

Although  quas  i  1  inea r  i  zat  ion  exhibits  quadratic  con¬ 
vergence,  its  domain  of  convergence  is  considerably  smaller 
than  other  techniques  such  as  gradient  methods  or  in¬ 
variant  imbedding  [2].  Consequently  these  other  techniques 
have  to  be  used  as  a  "starter"  for  quas  i  1  inear  izat  ion  [12]. 
Ramaker  et  al  incorporate  Marquardt's  method  into  the 
quas  i  1  inear  izat  ion  procedure  to  extend  the  domain  of  con¬ 
vergence.  Donnelly  and  Quon  [4]  proposed  an  unique  scheme 
whereby  the  experimental  data  are  perturbed  such  that  the 
initial  trajectories  are  within  a  specified  maximum  devi¬ 
ation.  The  magnitude  of  subsequent  data  perturbations  is 
governed  by  the  effect  on  the  unknown  system  parameters. 

If  the  change  in  the  parameters  is  deemed  too  large  (or 
small)  the  data  is  moved  closer  to  (farther  from)  the 
current  trajectories. 

A  more  intuitive  approach  is  presented  here.  Since 
linear  programming  techniques  allow  constraints  on  the 
parameters,  the  search  region  can  be  limited  in  parameter 
space  by  constraints.  Then  upon  convergence  the  region  can 
be  shifted  until  the  solution  is  no  longer  contrained  by 
art  if  ic  ial  bounds . 

Subsequent  examples  will  demonstrate  the  technique 
and  its  effectiveness. 


7.  RESULTS 


The  new  convergence  technique  introduced  previously 
is  illustrated  by  application  to  some  typical  identifica¬ 
tion  problems.  Practical  factors  with  regards  to  the 
computation  and  the  evaluation  of  the  fitted  model  are 
d  i  s  cus sed . 

7 . 1  Modelling  a  Pilot  Plant  Evaporator 

The  parameter  estimation  techn  iques  were  applied  to 
a  pilot  scale,  double  effect  evaporator  which  is  used  for 
process  dynamics  and  control  studies  at  the  University  of 
Alberta.  Refer  to  Appendix  A.  The  principal  components 
of  the  unit  are  the  two  effects. 

7.1.1  Derived  Model  Fitting 

Material  and  energy  ba 1 ances based  on  appropriate 
assumptions  produce  the  dynamic  model  presented  in 
Appendix  B,  which  is  composed  of  five  nonlinear  differential 
equations  and  a  set  of  algebraic  equations  as  presented  by 
Newell  and  Fisher  [24]  and  similar  to  those  reported  by 
Andre  and  Ritter  [25]. 

The  state  variables  are  the  liquid  levels,  the  first 
effect  temperature  and  first  and  second  effect  solution 
concentrations.  Because  of  large  differences  in  the  magni¬ 
tudes  of  these  state  variables,  normalized  perturbation 
variables  are  desirable. 


A  complete  discussion  of  the  development  of  this  model, 
a  comparison  with  other  models,  and  a  comparison  with  experi¬ 
mental  results  is  available  [24,26],  Although  actual 
transportation  lags  and  heat  transfer  dynamics  are  known 
to  be  small,  the  model  response  leads  the  experimental 
process  response  by  several  minutes.  Since  an  accurate 
model  was  required  for  state  driving  purposes  the  nonlinear 
model  was  coded  for  the  parameter  estimation  program.  The 
unknown  constants  were  assumed  to  be  the  heat  transfer  con¬ 
ductances,  UA 1  and  UA2,  the  heat  loss  terms,  HL1,  HL2,  and 
HL3  and  the  steady  state  holdups  in  each  effect,  W1  and  W2 . 

The  holdups  were  included  since  they  are  the  parameters  with 
the  largest  effect  on  the  dynamic  response  and  can  be  adjusted 
to  compensate  for  the  omission  of  effects,  such  as  tube  wall 
dynamics,  from  the  model.  The  heat  loss  terms  were  not 
arbitrary  in  that  closure  of  the  initial  steady  state  energy 
balance  had  to  be  forced  through  the  use  of  constraints.  in 
fact  HL1  was  a  fixed  parameter  and  HL2  and  HL3  were  related 
by  the  linear  constraint  that  their  sum  was  equal  to  a  con¬ 
stant  determined  from  steady  state  data. 

Figure  2  compares  the  theoretical  model  response  (dashed), 
the  fitted  model  response  (solid)  and  the  process  re¬ 
sponse  (symbols)  for  an  equivalent  disturbance.  This  plot 
shows  that  the  lead  exhibited  by  the  theoretical  model  can 
be  substantially  reduced  by  fitting  the  model  to  the  pro¬ 
cess  response.  The  gain  of  the  fitted  model  can  be  forced 
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FIGURE  2:  Product  Concentration  Response  to  20^  Step  Steam  Flow 
- 5NL,  -  5NLF-,  A  experimental. 


to  closely  approximate  the  experimental  by  appropriate 
state  variable  weighting  or  constraints  on  the  state 
variable  derivative  at  the  end  of  the  transient.  This 
is  demonstrated  in  Figure  2  by  comparing  the  model  tra¬ 
jectories  to  the  process  response  at  large  time. 

The  linearized  version  of  the  fitted  model  produced 
a  much  greater  improvement  over  the  linearized  theoretical 
mode  1  when  app 1  i ed  in  optimal  state  driving  implementation 
than  is  suggested  by  the  relative  goodness  of  fit  in 
Figure  2.  This  is  demonstrated  in  Chapter  5*  This 
emphasizes  that  the  true  adequacy  of  a  model  is  best 
evaluated  from  its  performance  in  the  application  for 
which  it  was  obtained. 


7.1.2  Empirical  Model  Fitting 

A  second  order  model  of  the  evaporator  in  the  form  de¬ 
fined  by  equation  (31)  was  desired  for  use  in  a  study  of 
state  driving  techniques  [27]  because  an  analytical  ex¬ 
pression  was  available  for  the  time  optimal  switching  times 


C2(s) 
S  (s) 


~T 


K  e 


ds 


(t1s+1)(t2s+1) 


(31) 


A  typical  fit  of  this  model  to  experimental  process  re¬ 
sponse  is  shown  by  the  sol  ?d  curves  in  F  igure  3*  The 
assumption  of  constant  gain  was  not  satisfactory  for  the 
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range  of  experimental  conditions  employed.  Therefore  the 
following  nonlinear  expression  was  derived  from  the  steady 
state  material  and  energy  balances: 

K  =  Kl/( 1  -  Kl  AS/C2)  (32) 

The  derivation  and eva 1 ua t  ion  of  equation  (32)  is  presented 
in  Appendix  1  for  Chapter  Three.  The  time  delay,  t^,  can 
be  determined  by  the  parameter  estimation  algorithm  how¬ 
ever  it  is  best  specified  by  the  user  from  a  priori  know¬ 
ledge  and  close  examination  of  the  experimental  results. 

It  was  observed  that  for  the  experimental  response  curve 
of  the  evaporator  many  combinations  of  and  and  t 
produced  equivalent  "goodness"  of  fit.  However  these 
models  performed  very  differently  in  the  state  driving 
applications  [27].  More  than  a  good  fit  is  required  em¬ 
phasizing  the  need  to  incorporate  a  priori  knowledge 
into  the  identification. 

7 . 2  I  den t ? f ? cat  ion  of  a  Kinetic  Model  Using  the 
New  Convergence  Technique 

Frequently  a  system  is  encountered  where  knowledge  of 
the  parameters  is  insufficient  to  permit  a  guess  close 
enough  to  the  true  solution  to  obtain  convergence.  The 
convergence  promotion  procedure  introduced  above  is  valuable 
in  such  an  instance.  The  technique  is  used  to  solve  a  non- 
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linear  reaction  kinetics  problem  solved  by  Donnelly  [28] 
using  quasilinearization  and  least  squares  comb i ne d  with 
data  perturbat  ion .  The  model  can  be  expressed  in  the 
fo 1  lowing  fo rm: 


UA  | 

dt 

CM  — 

X 

03 

1 

II 

-  ke,  x2)  -  a£( x i 

-  ke2  x^) 

(33) 

dx2 

dt 

=  al  (x,  - 

ke!  x2)  -  a3  (x2 

-  ke^  x^) 

(34) 

X3 

=  1  . 0  -  x  j 

x2 

(35) 

where  a ^ , 

and  a^ 

are  unknown  parameters  and  ke^. 

ke2  and 

ke^  are  known  equilibrium  constants. 


Transient  data  was  generated  from  various  initial  con¬ 
ditions  using  the  values 

aT  =  [2.0  3-5  5.0]  with  keT  =  [1.8  3-0  1.0]. 

Donnelly  found  an  initial  guess  of  a^  =  [  1 0  10  10]  would 

not  converge  without  data  perturbation.  Using  linear  pro¬ 
gramming  and  quas  i  1  inea r i zat  ion  the  method  converged  di¬ 
rectly  without  a  stepping  procedure.  This  is  attributable 
to  the  non-negativity  constraint  inherent  in  linear  pro¬ 
gramming.  The  least  squares  technique  on  the  other  hand 
allows  the  rate  constants  to  become  negative. 


' 


The  constrained  parameter  stepping  procedure  entails 
assuming  an  initial  parameter  vector  which  is  contained 
in  the  bounds  assigned  to  each  parameter.  Change  limits 
must  also  be  assigned  to  these  bounds.  A  change  limit  of 
zero  indicates  a  physical  constraint.  The  change  limit 
is  defined  as  the  maximum  amount  which  a  bound  can  be 
perturbed  for  the  next  step. 

This  approach  was  used  for  the  initial  parameters 
vector  and  bounds  indicated  in  Table  1  with  an  initial 
change  limit  of  five  for  all  constraints.  The  results 
are  summarized  in  Table  1.  Figures  4  and  5  illustrate 
the  solution  for  data  set  one. 

This  problem  required  just  over  one  minute  computer 
time  on  an  IBM  3^0/67  which  is  comparable  to  the  time 
required  via  least  squares  solution.  The  execution  times, 
of  course,  depend  on  the  initial  bounds  and  change  1  imits 
which  inturn  determine  the  number  of  steps  required. 

With  reference  to  Table  1,  the  maximum  number  of 
iterations  in  Phase  I  f  ie  as  long  as  there  are  artificial 
constraints)  is  three  since  an  extremely  accurate  solution 
is  not  necessary.  In  Phase  I  I  the  number  of  iterations 
may  be  increased  to  a  maximum  value^set  in  this  algorithm 
to  be  ten. 

The  constrained  parameter  technique,  although  it  is 
intuitive,  may  result  in  an  infeasible  solution  if  very 
poor  estimates  of  the  parameters  are  furnished.  The  data 
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TABLF  1 


CONSTRA INED 

PARAMETER 

STEPP  ING 

PROCEDURE 

Phase 

1 

Lower 

Upper 

So  1 ut  ion 

Max 

1  tera- 

Step 

L  imit 

Guess 

Limit 

Vecto  r 

Dev . 

t  ion 

12 

20 

25 

12 

1 

12 

20 

25 

12 

•  371 

2 

12 

20 

25 

12 

7.0 

12 

20 

7. 

2 

7.0 

12 

20 

7. 

.255 

2 

7.0 

12 

20 

7. 

2.0 

7.0 

15.0 

2.0790 

3 

2.0 

7.0 

15.0 

3 .2514 

.0000776 

3* 

2.0 

7.0 

15.0 

4.9154 

Phase 

1  1 

0.0 

2.079 

2.0008 

0.0 

3.2514 

3.4958 

.0000625 

2 

0.0 

4.9154 

5.00085 

*Maximum  Allowable. 


• 
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FIGURE  4:  Convergence  of  Nonlinear  Kinetics  Example 
Using  Constrained  Parameter  Perturbation 
(Data  Set  1) 
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TIME 

FIGURE  5:  Final  Solutions  of  Nonlinear  Kinetics  Example 
(Data  Set  1) 
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perturbation  technique  proposed  by  Donnelly  and  Quon 
alleviates  this  problem  but  the  choice  of  the  data  per¬ 
turbation  parameters  is  much  less  intuitive  and  the  con¬ 
trol  parameters  more  difficult  to  specify  a  priori. 


7 . 3  I  dent i f i cat  ion  of  a  Complex  Reaction 

The  following  mechanism  was  proposed  by  Chemcel 1 
Limited  to  describe  a  reaction  of  interest  to  their 
research  personnel: 


H+  +  x 


x 


4 


W  4-  v  , 

••4 


X  +  v 

'  '2  5 


X 


5  a 


7 


x6  +  x2  +  H 


4  + 

xc  x~  +  W  +  H 

5  3 


Xg  -  Co  ( x  1  +  x^  +  x^  +  Xp.)  (36) 


Several  experiments  were  performed  at  constant  tempera¬ 
ture  in  a  batch  reactor.  The  concen t r at  ions  of  x^,  and 
x^  were  measured  throughout  the  reaction  transient.  The 
concentrations  H"1  ,  W  and  Co  were  assumed  constant  for  a 


g i ven  exper  iment . 
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The  following  set  of  ordinary  differential  equations 
may  be  written  to  describe  the  above  mechanism: 


dx 


1 


dt 

dx, 

dF 


“  a]H  xj  +  a5x4 


a„wx^  +  a0xr  -  a^xAxn  -  a^ H+x^x, 


3  5 


625  “  7  a6a2 


(37) 


(38) 


dx 


dt 

dx 


1 


4 


dt 


acxc 

5  5 


0  =  a,H'x,  -  arXh  -  aAwxi,  +  arxAx, 


rl+''i 


5  h 


,2wa7  625 


(39) 


(40) 


dx 


dt 


2  =  0  =  a^wx4  -  afixpxs  -  a,x^  +  a?H+xsxp  -  ajx^  (4l) 


'6a2a5  “  3  5  7  6  2 


j4a5 


The  parameters  a^  through  a^  are  unknown  and  must  be 
determined.  The  stationary  state  approximation  to  equation 
(40)  and  (4l)  reduces  the  state  vector  to  three  components, 
x^,  x^  and  x^  all  of  which  are  observed. 

Fisher  [29]  approximated  the  solution  to  this  problem 
using  analog  computer  techniques.  He  concluded  that  a^,  a^ 
and  a^  could  not  be  determined  accurately  from  the  data  and 
therefore  were  assigned  values  based  on  other  a  priori  know¬ 
ledge  of  the  system.  The  other  constants  were  then  determined 
by  adjusting  potentiometer  settings  until  a  "good"  fit  was 
obta  ined . 


,, 
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Since  the  linear  programming  approach  allows  con¬ 
straints,  the  same  approach  is  possible.  Use  of  a  seven 
parameter  model  with  some  values  fixed  is  advantageous 
since  if  subsequent  experimentation  resulted  in  measure¬ 
ment  of  intermediates  etc,  these  constraints  could  be  re¬ 
laxed  without  having  to  change  the  model. 

The  experimental  data  has  been  reported  elsewhere 
[28,29]  and  will  not  be  repeated  here.  The  constrained 
parameter  stepping  procedure  discussed  in  the  previous 
example  proved  effective  in  the  solution  of  this  problem. 

The  results  of  the  identification  procedures  are  presented 
in  Table  2  for  the  analog  and  digital  techniques. 

Except  for  parameter  a^  and  to  a  lesser  degree  a^, 
the  parameters  could  not  be  estimated  accurately  from  the 
data.  This  is  a  direct  result  of  the  fact  that  the  re¬ 
act  ion  intermediates  are  not  measured  and  that  the  initial 
conditions  are  all  on  the  same  variable.  However  as  indicated 
by  Figure  5*  these  constants  do  provide  an  accurate  re¬ 
presentation  of  these  experimental  data. 

Donnelly  [28]  was  unable  to  work  with  the  full  seven 
constant  model.  However  he  was  able  to  solve  a  reduced 
model  which  had  only  four  constants  in  three  differential 
equations.  The  model  was  derived  from  a  simplified  mechan¬ 


istic  mode  1 . 


SEVEN  CONSTANT  REACTION  MODEL  IDENTIFICATION 
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dx  j  + 

dt  =  alH  WX1 

dx2 

~  ^2X4  ^ x2x6  +  a  -jH  wx  -j 

dxo 

dt  =  a3x4 

and  the  algebraic  re  1  at  ionsh ips 

x6  =  Co“  (X1  +  x3  +  (^5) 

a1x]H+w  +  a.(H  +  x2  ( CQ  -  x]  -  x?) 

=  +  ~~  ■ 
a2  +  a3  +  a5H  x2 

Application  of  the  Chebyshev  criterion  to  this  problem 
yielded  results  equivalent  to  those  obtained  by  Donnelly 
as  indicated  in  Table  3*  The  covariance  matrix  for  the 
parameters  is  presented  in  Table  3  also.  It  is  assumed 
that  the  errors  and  the  parameters  are  normally  distributed. 
The  diagonal  elements  of  the  matrix  are  the  variances  of  the 
parameters.  These  can  readily  be  converted  into  confidence 
limits  as  was  done  in  Table  2.  The  off  diagonal  elements 
are  the  covariances.  This  statistic  is  a  measure  of  the 
statistical  interaction  between  constants.  The  Pearson 
correlation  coefficient  [17]  is  often  used  as  a  standard  in 
determining  statistical  dependence  between  random  variables. 
Zero  indicates  no  interaction  and  unity  indicates  complete 
interact  ion . 


(42) 

03) 

(44) 


COMPARISON  OF  LEAST  SQUARES  AND  CHEBYSHEV  SOLUTIONS  TO 
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These  variances  may  be  used  to  determine  subsequent 
experimental  approaches  or  to  determine  the  reliability  of 
the  mode  1 . 

7 . 4  identification  with  Unknown  Initial  Conditions 

As  indicated  above  the  number  of  equations  involved 
in  the  quas  i  1  i  nea r  i  zat  ion  method  is  subs t an t  i  a  1 1 y  reduced 
by  assuming  the  initial  conditions  are  known. 

This  requirement  can  be  relaxed  by  a  simple 
transformation  of  variables  to  perturbation  variables.  If 
a  system  is  represented  by  equat  ion  (  1)  where  x(0)  =  xq 
is  not  well  defined  then  let  x‘  =  x  -  xq  and  the  model 
becomes 

X'(t)  =  i(x'(t)  +  xo,  p) 

£  =  0  07) 

x  =  0 

— o  — 

where  x 1 ( 0)  =  0 

However  there  is  a  loss  of  accuracy  involved  in  this 
app  roach  since 

V(x')  =  V(x)  +  V ( xQ)  (48) 

The  technique  will  be  illustrated  by  a  simple  example  pre¬ 
sented  by  Bellman  et  al  [3,6]  who  solved  the  problem  by 
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quas  i  1  i  nea r  i  zat  ion  both  in  conjunction  with  least  squares 
and  linear  programming. 

The  nonlinear  second  order  Van  der  Pol  equation  is 
the  system  model : 


x  +  X(x2  -  1)  x  +  x  =  0  (49) 

where  X  is  to  be  estimated  from  the  following  experimental 
obse rvat  ions 


X 

(4.0) 

=  -  1.80843 

X 

(6  .0) 

-  1 .63385 

X 

(8.0) 

=  -  1 .40456 

In  state  va r  iab 1 e 

notation  equation  (49)  becomes: 

• 

X 

= 

u 

• 

u 

= 

-  X(x2  -  1 )  u  -  x 

(50) 

• 

X 

= 

0 

where  u  =  x  and  x 

=  x . 

However,  since  the  initial 

cond i t ion , 

u  (4.0),  is  not  measured  a  new  set  of  state  variables  is  defined 
such  that: 

x  j  =  x 

x2  =  u  -  u  (4.0)  (51) 

Then  X  and  u(4.0)  can  be  estimated  since: 
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x 


x2  +  u  (4.0) 


x 


2 


-  -  l)(x2  +  u  (]+-°))  -  x)  (52) 


X 


0 


u  (4.0) 


0 


where  x]  (4.0)  and  x2  (4.0)  are  known. 

Equations  (52)  are  now  in  a  form  compatible  with  the 
quasil  inear  identification  algorithm  employing  either  least 
squares  or  linear  programming.  The  numerical  results  are 
summarized  in  Table  4  for  the  least  squares  algorithm. 

8.  CON  CL  US  IONS 

Quas i  1  inear  izat  ion  in  conjunction  with  linear  programming 
was  demonstrated  to  be  an  effective  general  numerical  method 
for  the  nonlinear  boundary  value  problem  arising  in  parameter 
estimation. 

Several  linear  performance  indices  are  compatible  with 
linear  programming  in  the  context  of  the  algorithm. 

A  new,  intuitive  technique  for  promoting  convergence 
was  successfully  tested  on  several  nontrivial  problems. 

Reliability  estimates  for  the  parameters  are  readily  gen¬ 
erated  using  the  algorithm  presented  in  this  paper. 

The  algorithm  allows  the  incorporation  of  a  prior?  know¬ 
ledge  of  the  system  in  the  form  of  state  variable  weighting, 
parameter  and  state  constraints  and  state  variable  normaliz¬ 
ation. 
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TABLE  4 

VAN  DER  POL  PROBLEM  RESULTS 


Iteration 

X 

u  (4.0) 

0 

7.0 

0.08 

1 

7.93266 

-  0.495475 

2 

9.91558 

0.0527966 

3 

10.0007 

0.0787886 

4 

10.0004 

0.0791647 

5 

10.0003 

0.0790561 

final  value 

10.0004 

0.0791 1 16 

true  value 

10.0000 

0.079366909 

. 

CHAPTER  FOUR 


COMPUTER  CONTROL  USING  OPTIMAL  STATE- 
DR  IV  ING  TECHN  IQUES 


ABSTRACT 

This  paper  deals  with  the  det e rm i na t  ion  of  an  optimal 
means  of  driving  a  multivariable  process  from  one  state  to 
another  subject  to  constraints  on  the  control  and  state 
variables.  The  dynamic  optimization  is  based  on  a  linear 
programming  formulation  utilizing  a  process  model  in  the 
standard  state-space  form  and  a  minimum  time  performance 
criterion.  The  discrete  time  series  of  values  produced 
for  each  control  variable  are  then  applied  to  the  process 
in  an  open-loop  mode  to  drive  the  process  to  the  desired 
operating  state.  Results  from  simulation  and  experimental 
studies  on  a  pilot  plant  scale  double  effect  evaporator 
operating  under  computer  control  are  used  to  illustrate 
the  improvement  in  performance  and  some  of  the  factors 
that  arise  in  practical  applications. 
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1  •  I NTRODUCT ION 

During  the  last  decade  a  great  many  theoretical  and 
simulation  studies  have  demonstrated  the  potential  bene¬ 
fits  of  optimal  multivariable  control.  Over  the  same  time 
period  a  large  number  of  industrial  plants  have  installed 
real-time  process  control  computers  and  hence  have  the 
hardware  capability  of  implementing  optimal  control  tech¬ 
niques.  However,  to  date,  there  have  been  few  industrial 
app  1  ica t  ions . 

The  purpose  of  this  paper  is  to  describe  the  applica¬ 
tion  at  the  University  of  Alberta,  of  optimal  state¬ 
driving  techniques  to  a  pilot  plant  evaporator  controlled 
by  an  IBM  1800  computer. 

S tate-dr  iv  ing  techniques  are  a  good  choice  for 
initial  applications  in  optimal  control  because: 

(1)  every  process,  even  if  it  is  only  during  start¬ 
up  and  shutdown,  is  subjected  to  preplanned 
changes  in  operating  conditions 

(2)  the  "bang-bang"  control  that  results  from  the 
time  optimal  control  formulation  can  be  imple¬ 
mented,  progressively,  in  any  desired  number  of 
steps  from  the  familiar  "set  the  inputs  to  the 
values  applicable  at  the  desired  steady  state" 
to  the  actual  optimal  procedure 
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(3)  provided  the  number  of  manipulated  variables 

is  not  excessive  the  optimal  bang-bang  sequence 
can  be  implemented  by  the  process  operators 
using  the  "manual"  mode  of  conventional 
i  ns t  rumentat ion 

(4)  with  the  method  proposed  herein  there  is  no 
severe  limit  on  the  dimensionality  of  the 
problem  and  the  optimal  control  calculations 
can  be  done  off-line  using  any  standard 
linear  programming  system,  such  as  IBM's 
MPS  package. 

If  a  process  can  be  accurately  represented  by  a  linear, 
t  ime- i nva r  i an t  model  then  techniques  for  unconstrained 
optimal  control  can  be  applied  directly.  However  in  most 
practical  applications  the  process  is  non-linear  and  a 
satisfactory  model  cannot  be  derived  on  a  purely  theore¬ 
tical  basis.  Therefore,  this  study  compares  the  results 
obtained  using  both  theoretical  and  empirical  models  of 
different  complexity.  It  also  demonstrates  the  use  of 
constraints  on  both  the  control  and  state  variables. 

The  following  sections  include  a  brief  literature 
survey,  a  description  of  the  problem  formulation  and  a  dis¬ 
cussion  of  the  results  of  simulated  and  experimental  studies 


137 


2.  LITERATURE  REV  I  EW 

Any  optimal  control  procedure  requires  careful  defini¬ 
tion  of  the  criteria.  The  "time  optimal"  or  "minimum 
response  time"  criterion  is  used  in  this  work  because  it  is 
particularly  convenient  for  analysis  and  in  most  instances 
closely  approximates  the  actual  economic  criteria.  However 
since  linear  programming  is  used  to  solve  the  optimal  con¬ 
trol  problem  then  ITAE,  IAE,  minimax  and  minimum  rise  time 
(for  a  specified  settleout  time  and  maximum  overshoot)  can 
also  be  employed  as  objective  functions  as  will  be  demon¬ 
strated  in  Chapter  5. 

Latour,  Koppel  and  Coughanowr  [1]  present  analytical 
expressions  for  the  optimal  switching  times  for  any  over¬ 
damped  single  input,  single  output  system  that  can  be 
adequately  represented  by  a  second  order  transfer  function 
(with  or  without  a  pure  time  delay).  Use  of  this  method 
resulted  in  significantly  better  performance  than  that 
obtained  using  a  well  tuned  PID  controller  and  the  improve¬ 
ment  increased  with  the  magnitude  of  the  change.  However, 
more  sophisticated  methods  are  required  for  multivariable 
applications.  The  two  most  popular  approaches  of  deter¬ 
mining  the  time  optimal  policy  have  been  dynamic  programming 
and  Pontryagin's  maximum  principle  [2].  These  methods  pro¬ 
duce  excellent  results  but  often  run  into  numerical  and/or 
dimensionality  problems  when  they  are  applied  to  real 
systems.  Zadeh  and  Whalen  [3]  showed  that  the  time  optimal 
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and  fuel  optimal  control  problems  could  be  reduced  to 
linear  programming  problems  for  linear,  discrete  time- 
invariant  systems  and  Bondarenko  and  Filimonov  [4]  present 
numerical  results  based  on  these  two  criteria.  This 
linear  programming  formulation  offers  the  advantages  of 
greater  numerical  stability  and  the  ability  to  handle  large 
multivariable  systems  with  constraints  on  the  control  and/ 
or  state  variables. 

Lesser  and  Lapidus  [5]  use  the  linear  programming  for¬ 
mulation  to  determine  the  time  optimal  control  of  an  ab¬ 
sorber  described  by  a  sixth  order  state  difference  equation. 
Inlet  concentrations  were  used  as  the  control  variables 
in  order  to  linearize  the  model  and  were  constrained  to 
keep  the  solution  in  a  feasible  region. 

Lack  and  Enns  [6]  use  a  minimax  objective  function  and 
compute  the  optimal  control  for  a  model  of  a  nuclear  reac¬ 
tor  with  twenty-one  state  variables.  Sakawa  and  Hayashi 
[7]  extend  the  discrete  linear  programming  formulation  to 
obtain  approximate  solutions  for  continuous  systems. 

Torng  [8]  points  out  that  the  linear  programming  solution 
might  not  be  unique  under  all  conditions.  However  this 
approach  appears  to  be  valid  for  the  majority  of  chemical 
engineering  problems. 


. 
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3 •  ■  DESCRIPT  ION  OF  EQU  I PMFNT 

The  optimal  state  driving  control  techniques  described 
in  this  paper  were  applied  to  a  pilot  plant  size,  double 
effect  evaporator  at  the  University  of  Alberta.  Appendix 
A  contains  the  equipment  details  and  a  brief  description 
of  the  IBM  1800  control  computer.  The  direct  digital 
control  (DDC)  monitor  was  used  to  operate  transmitters 
and  final  control  elements  for  the  cases  reported  herein. 

The  three  master  loops  were  placed  on  manual  and  the  contol 
action  was  implemented  by  manually  changing  the  setpoints 
of  the  three  slave  loops.  Refer  to  Figure  1. 

4 .  PROCESS  MODELLING  AMD  IDENTIFICATION 

Before  any  optimal  control  calculations  can  be  carried 
out  it  is  necessary  to  develop  a  suitable  mathematical 
model.  The  models  used  in  this  study  fall  into  two  cate¬ 
gories:  those  derived  by  fitting  an  assumed  model  form  to 
the  actual  process  response  and  those  based  on  a  theoretical 
analysis  of  the  evaporator. 

For  modelling  purposes  the  principal  components  of  the 
evaporator  system  are  the  two  effects.  A  mass  balance, 
component  balance  and  heat  balance  on  each  effect  yields 
six  first  order  differential  equations.  However,  the  pres¬ 
sure  (vacuum)  in  the  second  effect  is  closely  controlled 
and  hence  the  energy  accumulation  in  the  second  effect  can 
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be  neglected.  Similarly  the  dynamic  behaviour  of  the  two 
steam  chests  and  the  inter-effect  vapor  space  can  be  neg¬ 
lected  so  that  the  dynamic  model  is  composed  of  five  non¬ 
linear  differential  equations  and  a  set  of  algebraic 
equations  similar  to  those  reported  by  Andre  and  Ritter 

[9] .  This  non-linear  model  can  then  be  linearized  by  the 
introduction  of  perturbation  variables  and  numerical 
values  calculated  for  all  the  coefficients.  The  result 
expressed  in  the  standard  state  variable  form,  equation 
(1),  is  given  as  linear  model  5L)  in  Appendix  B. 

x(t)  =  Ax(t)  +  Bu( t) 

A  more  complete  discussion  of  the  development  of  this 
model,  a  comparison  with  other  models  and  a  comparison  of 
the  model  responses  with  experimental  data  from  the  evapor¬ 
ator  is  available  [10]. 

For  state  driving  purposes  the  most  important  state 
variable  is  the  concent  rat  ion ,  C^y  and  this  is  normally 
controlled  by  manipulating  the  steam,  S.  It  can  be  shown 

[10]  that  by  neglecting  interactions  the  transfer  function 
relating  and  S  is: 


(i) 


' 
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C2(s)  _  Kp(T3  s+1) 

S(s)  “  ( T l s+ 1 ) ( TgS+ ) ) 


(2) 


Since  analytical  methods  exist  in  the  literature  for 
second  order  models  it  was  desired  to  obtain  a  model  in 
the  following  form: 


Cg(s)  _  Kpexp(-Tds) 


(3) 


S ( s )  (t]s+1)(t2s+i) 


The  time  constants  and  gain  coefficients  in  the  above  two 
models  were  determined  by  means  of  a  parameter  estimation 
method  employing  quas i 1 i nea r i zat ion  and  linear  programming 
as  discussed  in  Chapter  Three. 

Previous  experience  showed  that  these  simple  models 
gave  a  reasonable  approximation  to  the  process  dynamics 
but  due  to  non  1 i nea r  i  t  i  es  in  the  process  did  not  give  accur¬ 
ate  steady  state  values  for  open  loop  changes  of  greater 
than  about  five  percent.  Therefore  the  following  gain 
expression  was  developed  based  on  a  simplification  of  the 
non-linear,  steady  state  material  and  energy  balance 
equat ions : 


AC 


K 


P 


KL  (  1  + 
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o  r 
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K  =  KL 

P  (  1  -  KL  ~) 

2 

This  gain  expression  was  particularly  valuable  in  estima¬ 
ting  the  value  of  the  control  variable  (steam)  to  be  used 
at  the  end  of  the  optimal  state  driving  procedure.  The 
derivation  and  performance  evaluation  is  presented  in 
Chapter  Three. 

5  •  FORMULATION  OF  THE  OPTIMAL  CONTROL  PROBLEM 

For  an  n*1  order  1  Lnea  r ,  t  ime  invar  iant,  con  t  inuous  model  with 
real  e  i  genva lues ,  Athans  and  Falb  ( p  402  [11]  show  that  the 
total  number  of  switches  in  each  of  the  control  variables 
must  be  less  than  or  equal  to  (n  -  1).  (Changes  in  the 
control  variables  that  are  smaller  in  magnitude  than  the 
difference  between  the  upper  and  lower  constraints  are 
not  counted) . 

Latour  et  al  [1]  have  shown  that  for  a  system  described 
by  equation  (3)  the  time  optimal  control  trajectory  is  of 
the  classic  "bang-bang"  nature:  i.e.  at  time  t  ,  u(t)  is 
set  equal  to  the  upper  constraint  value  Uy ;  at  time  t|,  'u(t) 
is  set  to  the  lower  constraint  value  U^;  and  at  time 
u(t)  is  set  to  the  new  steady  state  value.  A  trajectory 
of  this  type  is  shown  in  Figure  4.  The  following  implicit 
expression  was  derived  [1]  for  time,  t  ^ . 


* 
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VUU  -  UL)  -  ro  -  ULKp)  exP 

(KPuu  -  r) 


t2/t, 


KP<UU  -  V  -  (ro  -  ULKp)  exP  ("W 

(KPuu  -  r) 


(5) 


where:  r  <  rQ  ,  t£  <  ,  Cg  (0)  =  0  ,  Cg  (0)  =  rQ 


When  required  for  this  wo rk  ,equa t  ion  (5)  was  solved 
for  t i  using  the  golden  section  univariate,  direct  search 
algorithm  (see  Case  2). 

The  final  switch  time,  t^,  is  calculated  from  the 
following  explicit  equation:  [1] 


t  f5n 


VW'WW)  exp(W 


r  -  K  UM 
P  u 


(6) 


For  a  first  order  process  such  as  that  defined  by  equa¬ 
tion  (2)  there  is  only  one  switching  time  and  it  can  be 
calculated  from: 


t 


1 


=  t  Hn 


r  -  K  U. 
o  p  L 

r  -  KpUL 


(7) 


In  all  of  the  above  equations  if  (r  >  rQ)  then  Uu  and 
must  be  interchanged.  Also  if  the  pure  time  delay  in 
equation  (3)  is  not  zero  then  the  effect  of  the  switches 
will  not  be  observed  for  units  of  time  and  in  fact  the  new 
state  will  not  be  attained  until  t^  +  T ^  units  of  time. 
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If  a  mu  1 1  i -va r i ab 1 e  process  can  be  adequately  descr ibed 
by  the  following  linear,  t ime- i nva r i ant ,  state-space 
mode  1 : 

x(t)  =  _A  x(t)  +  B__u(t)  (8) 

then  the  optimal  control  problem  becomes  that  of  determining 
the  trajectories  of  the  control  variables,  u_,  to  drive  the 
system  from  its  initial  state,  xq,  to  the  desired  final 
state,  x.^,  while  minimizing  a  particular  objective  function 
such  as  process  response  time.  If  the  output  variables 
are  a  1  inear  function  of  the  state  only  (  i.e.  Y.  =  Cx) 
then  the  problem  can  also  be  stated  in  terms  of  Y_. 

The  discrete  form  of  the  analytical  solution  to  equa¬ 
tion  (8)  can  be  written  [12]  as: 


x(k  + 

1) 

=  . 

x(k) 

+  A  ju(k) 

(9) 

Repeated 

use  of 

equat  ion 

(9) 

to  calculate  the  state  at 

each  t  ime 

i  nt erva 1 

yields 

x(l) 

= 

&  x( 0) 

+ 

A  u(0) 

x(2) 

• 

• 

4px(o) 

• 

• 

+ 

<b  A  _u(  0)  +  A  _u  (  1 ) 

(10) 

• 

• 

x(N) 

• 

• 

/x(0) 

+ 

0^  ^ A  u(O')  +  ...  +  Au f N - 

l) 

' 
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The  computational  problem  is  then  to  determine  the 
minimum  number,  N,  of  control  intervals;  i.e.  the  minimum 
time,  required  to  drive  the  system  to  the  desired  state 
subject  to  constraints  on  the  control  and/or  state  variables. 
To  solve  this  problem  a  variable  X  is  defined  as 

X  £  |  x  j  ( N )  -  xdJ|  for  all  i  =  1,2,  ...,  n  (11) 

Or  in  a  form  more  convenient  for  linear  programming. 

Xj(N)  +  X  ^  xdi  i  =  1  ,  2,  . . . ,  n  (12) 

x  j  ( N )  -  X  <  xdi 

In  matrix  notation,  incorporating  the  expression  from  equa¬ 
tion  (10)  and  defining  a  vector  _e .  of  weighting  factors 
to  be  assigned  to  the  state  variables,  results  in  equation 
(13).  The  solution  is  an  iterative  one:  a  value  for  the 
number  of  sampling  intervals,  N,  is  assumed  and  the  linear 
programming  algorithm  Is  used  to  find  the  discrete  values  of 
the  control  vector  u(k)  k  =  1,2,.».,N  that  will  drive  X  to 
zero.  If  the  solution  is  successful  a  smaller  value  of  N 
is  assumed  and  the  procedure  repeated  until  the  minimum 
value  of  N  that  will  keep  X  within  the  desired  limits 
(X  «  0)  is  obt a  i ned . 

Constraints  on  the  state  variables  at  the  sampling 
points  are  incorporated  into  the  formulation  via  equation 
(10).  In  the  most  general  case  these  constraints  can  be 


' 
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time  varying.  If  each  state  variable  is  constrained  at 

each  sample  time  by  upper,  x  ,  and  lower,  x  ,  limits 

U  ,  K  L  ,  K 

then  the  formulation  is  as  shown  in  equation  (l4).  This 
represents  a  linear  programming  problem  with  2(n  +  Nn) 
rows  in  (Nm  +  1)  variables.  If  the  number  of  rows  exceeds 
the  number  of  va r  iab 1 es, then  the  dual  linear  programming 
problem  is  computationally  more  efficient  [13].  it  is 
apparent  from  a  comparison  of  equations  (13)  and  ( l4)  that 
state  variable  constraints  rapidly  increase  the  dimension 
of  the  problem.  Control  variable  constraints  can  be  in¬ 
corporated  without  increasing  the  size  of  the  problem  [15]. 

The  following  sequence  of  steps  was  incorporated  into 
a  program  for  an  IBM  360/67  computer  to  generate  the  con¬ 
trol  and  state  variable  trajectories: 


(1)  linearize  the  fifth  order  non-linear  model  about 
the  desired  steady  state 

(2)  generate  and  A  the  state  difference  equation 
coefficient  matrices  [l4] 


,N  -2 

A 


A 


^N-]a  N  -2 

&  A  0  A 


A 

A 


_ _ 1 

^0 

Ad 

,N  *1 

-  0  X 

— o 

'-^N  _ 

,*d 

,N 

-  0  X 
— o 

X 

Equat  ion  ( 13) 


N-l  A 

0  A 

,N-2a 

A  A 

...  A 

-N 

“ 

^0 

r  ,n  “i 

— d  ^  — o 

M-  1A 

_0  A 

-2 

A  A 

...  A 

~^N 

Jil 

< 

,N 

X  i  -  0  x^ 

A 

o 

...  o 

o 

• 

• 

X  -  0X 

— L!  (  O 

^  A 

A 

...  o 

o 

^-1 

X  -  0X 

u2  — ° 

• 

• 

X 

»  «. 

• 

• 

• 

,  N  1  A 

_0  A 

,N-2a 

A  A 

...  A 

o 

• 

x  -  Ax 
-uN  -  -o 

A 

o 

...  o 

o 

,N 

— L  j  -  ^ 

<1 

• 

•©i 

A 

...  o 

o 

X .  -  0^  X 

— L2  - - o 

• 

• 

• 

N-l  A 

^  A 

,N-2a 

A  A 

...  A 

o 

• 

• 

A,  "  A  2<o 

lN 

Eq uat ion  ( 1 4) 


- 


149 


(3)  formulate  the  linear  programming  problem  as 
per  equation  (l4)  and  store  it  on  the  disk 
in  the  proper  format  for  use  by  the  MPS/36O 
p  rog  ram 

(4)  solve  the  problem  using  MPS/36O  to  get 
u(k)  [15] 

(5)  generate  the  state  variable  trajectories  by 
applying  ju(  k)  to  the  process  model. 

A  typical  running  time  for  this  problem  with  5  state 
variables,  3  control  variables,  40  sampling  intervals 
and  constraints  on  the  state  and  control  variables  was 
about  one  minute. 

6  .  D  1 S CUSS  ION  OF  RESULTS* 

The  results  of  the  experimental  and  simulation  studies 
are  presented  as  a  series  of  five  cases  ranging  from  the 
simplest  single-input  single-output  approach,  to  multivar¬ 
iable  applications  based  on  a  fifth  order  evaporator  model 
with  state  and  control  variable  constraints. 

Figure  2  compares  the  response  of  the  nonlinear  eva¬ 
porator  model  when  subjected  to: 

(a)  an  open-loop  change  in  steam  flow; 

(b)  a  closed-loop  change  in  setpoint  (P  and  I  feedback 
controller  from  C 2  to  S  tuned  for  regulatory 

cont  ro 1 )  ; 

*Ref er  to  Appendix  C  for  add i t  iona 1  run  documentation 
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TIME  IN  MINUTES 

FIGURE  2a:  Simulated  Responses  of  Concentration  and  Liquid 
Levels  Under  Optimal,  Closed-Loop  and  Open- 
Loop  Control 

-  optimal,  -  closed-loop,  AAA  open-loop 
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F  IGURE  2b : 


TIME  IN  MINUTES 

Simulated  Responses  of  Flow  Rates  and  Temperature 
Under  Optimal,  Closed-Loop  and  Open-Loop  Control 
-  opt i ma 1 ,  -  closed— loop,  AAA  open— loop 
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(c)  optimal  open-loop  state  driving  (second  order 
model) . 

The  significantly  faster  rise  time  and  the  shorter 
transient  obtained  in  the  optimal  control  case  were  the 
motivation  for  further  investigation  into  the  effects  of 
model  accuracy,  constraints  and  physical  implementation. 

Case  1 :  0 gt  i[nal_Cont  ro I_Based_on_a_F  j_ r  s  t  _0  r  de  r  _Mode  1_ 

For  a  first  order  process  the  optimal  control  policy 
as  developed  in  this  paper  is  simply  to  step  the  input 
variable  (S)  to  its  maximum  value  and  hold  it  there  until 
the  controlled  variable  (C^)  reaches  the  desired  value. 

The  input  variable  is  then  changed  immediately  to  the 
value  required  for  the  new  steady  state.  It  should  be  em¬ 
phasized  that  the  optimal  control  calculation  produces 
the  switching  time  but  does  not  est  imate  the  value  of  the 
input  variable  required  for  the  new  steady  state.  (It 
must  be  found  "by  experience"  or  by  using  the  model.) 

The  solid  curve  in  Figure  3  shows  the  simulated  re¬ 
sponse  of  the  fifth  order  non-linear  model  to  an  optimal 
control  policy  based  on  a  first  order  model  fitted  to  the 
response  of  the  same  nonlinear  model.  At  the  precalculated 
switching  point,  the  concentration  is  at  the  desired  value 
and  reducing  the  steam  to  the  new  steady  state  value  should 
maintain  at  this  value.  Note  the  small  overshoot  that 
occurs  due  to  "higher  order"  components  of  the  fifth  order 
model  used  in  this  simulation. 


. 
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TIME  IN  MINUTES 


F  IGURE  3a: 


Responses  of  Concentrations 
for  Optimal  Control  Based  on 
Model s 


t  ight  LLC  , - 


and  Liquid  Leve 1 s 
First  0  rder 

. . .  exper imenta 1 


averaging  LLC, 


15^ 


TIME  IN  MINUTES 

FIGURE  3b:  Responses  of  Flow  Rates  and  Temperature  for 
Optimal  Control  Based  on  First  Order  Model 
-  tight  LLC ,  -  averaging  LLC,  ...  experimental 
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The  experimental  and  simulated  results  were  plotted 
on  the  same  graph  to  save  space  and  not  because  the  primary 
purpose  was  to  compare  the  two  responses. 

The  experimental  response  of  the  evaporator  when  sub¬ 
jected  to  an  "optimal11  steam  transient  based  on  a  first 
order  model  fitted  to  the  process  response  is  shown  by  the 
points  plotted  in  Figure  3*  (Note  that  this  experimental 
run  was  made  with  slightly  different  initial  and  final 
conditions.)  At  the  time  when  the  steam  is  switched  to  its 
final  steady  state  value  the  concentration,  Cg,  has  only  com¬ 
pleted  about  60 %  of  its  transient.  However,  the  optimal 
control  policy  was  based  on  a  model  of  the  form  Ke  d  / 

( t  s+ 1 )  where  T ^  =  5  minutes,  =  39  minutes,  K  =  O.IO85 
and  S  =  2.5  pounds  per  minute.  Thus  the  value  of  that 
was  reached  due  to  the  optimal  control  policy  is  found  at 
t 1  i.e.  five  minutes  after  the  steam  flow  was  reduced. 

However,  even  at  this  time  the  concentration  has  not  reached 
its  final  value  and  continues  in  an  open-loop  response. 

It  is  obvious  that  a  much  better  switching  time  could  be 
found  with  a  little  experience.  When  the  switching  was  done 
by  actually  measuring  and  switching  when  it  was  at  the 
desired  value,  then  there  was  a  small  overshoot,  similar 
to  the  solid  curve  in  Figure  3a,  due  to  the  "momentum  (heat 
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capacity)  of  the  actual  process  as  shown  by  the  solid 
curves  in  Figures  4  and  5. 

The  dashed  and  symbol  curves  in  Figures  4  and  5  cor¬ 
respond  to  experimental  response  of  the  evaporator  to  DDC 
setpoint  control  and  to  a  step  change  in  steam  to  the 
new  steady  state  value.  Note  that  the  setpoint  change 
under  the  DDC  regulatory  control  scheme  results  in  violation 
of  the  pressure  constraint  in  the  first  effect  as  can 
readily  be  seen  by  the  temperature  profile  in  Figure  5* 

The  true  measure  of  the  advantage  of  optimal  control 
is  obtained  by  comparing  it  with  the  conventional  methods. 
"Conventional  control"  on  the  evaporator  is  implemented  by 
using  an  inline  ref ractomete r  to  produce  a  continuous 
measurement  of  concentration  which  can  be  fed  back  to 
a  standard  P  arid  I  controller  which  manipulates  the  inlet 
steam  flow.  This  scheme  has  performed  satisfactorily 
for  years  as  a  regulatory  control.  However,  in  this  invest¬ 
igation,  where  very  large,  rapid,  changes  were  generated 
in  flows  and  temperatures,  it  was  found  that  tl^e.--  concent  r  a- 

.  r  ^  f  ... 

'  “'I  4.‘  ’  • 

-  , 

t ion  readings  were  unsuitable  due  to  temperature  and  flow 
interactions  with  the  r ef ractometer .  Daily  cleaning  of  the 
ref ractomet e r  prism,  careful  calibration  of  the  ref racto¬ 
meter  and  accurate  temperature  compensation  were  required 
before  on-line  switching  could  be  implemented. 


. 
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Experimental  Response  for  Real-Time  Switching 
Based  on  First  Order  Model 

-  real-time,  -  DDC  feedback,  AAA  open-loop 


F  IGURE  4: 


STEAM  FLOW  IN  LB /MIN  CONCN  IN  PC  GLYCOL 


Experimental  Response  for  Real-Time  Switching 
Based  on  First  Order  Model 

-  real-time,  -  DDC  feedback,  AAA  open-loop 


F  IGURE  5: 
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This  difficulty  actually  illustrates  an  important 
application  area  for  open  loop  state  driving,  i.e.  where 
the  necessary  measurement  transducers  are  not  available 
to  produce  readings  fast  enough  or  accurately  enough,  then 
open-loop  procedures  can  be  used  to  advantage. 

Another  refinement  which  developed  from  the  experi¬ 
mental  trials  was  a  change  in  the  liquid  level  control 
strategy.  For  standard  regulatory  control,  it  has  proven 
advantageous  to  use  P  and  I  "averaging"  rather  than  "tight11 
control  on  the  levels  ([l6]pl62)  in  the  first  and  second 
effects,  because  this  helps  to  damp  out  the  effects  of 
feed  flow  disturbances  on  Cp  .  However,  the  large  steam 
perturbations  introduced  by  hang-bang  control  produced 
significant  deviations  in  the  liquid  levels  and  these  were 
very  slow  to  be  corrected  as  shown  by  the  dashed  1 ine  in 
Figure  3*  Changing  to  relatively  high  gain  proportional 
control  on  the  levels  for  the  duration  of  the  state  driving 
transient  brought  the  evaporator  to  the  new  steady  state 
(Cp,  W1 ,  Wp,  etc.)  in  a  much  shorter  time  and  was  adopted 
for  all  the  runs  with  the  first  and  second  order  models. 

It  does,  however,  produce  larger  variations  in  the  mani¬ 
pulated  variables  B1  and  Bp.  An  alternative  solution  to 
this  problem  is  used  in  the  mu  1 1  i  va r  i  ab 1 e  cases. 


Case  I  I :  OQt  |mal__Cont  ro]__Based_on_a_S econd_0  r de r_Mode]_ 

It  was  expected  that  the  results  obtained  in  Case  I 
could  be  improved  by  using  a  model  that  would  more  accurately 
reproduce  the  process  response  and  also  make  it  possible  to 
el  iminate  overshoot  in  the  process  (C^)  response.  Accord¬ 
ingly,  a  second  order  model,  equivalent  to  the  transfer 
function  defined  by  equation  (3)  wa.s  assumed.  The  para¬ 
meters  t i  and  were  determined  by  using  a  computer  pro¬ 
gram  incorporating  quas  i  1  i  nea r  i  zat  ion  plus  linear  programming 
techniques  to  obtain  the  best  fit  between  the  state-space 
formulation  of  the  model  and  the  open  loop  response  of  the 
evaporator  as  discussed  in  Chapter  Three.  The  results  are 
shown  in  Table  1  . 


TABLE  1 

PARAMETERS  IN  SECOND  ORDER  FITTED  MODELS 


Mode  1 

F  i  tted  To 

T 

1 

T 

2 

V 

1 

Fifth  order  non- 
1  i nea r  model 

1.85  min 

29 . 0  min 

0  min. 

2 

Several  actual 
process  responses 

12.1 

20.2 

0 

3 

Several  actual 
process  responses 

7  .8 

22.3 

3  .0 

* 

Spec i f i ed  by  user 
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Models  2  and  3  have  equally  good  criteria  regarding  "goodness 
to  fit"  but  the  theoretical  model  and  other  experimental 
data  suggest  that  the  smaller  value  of  t  in  model  3  is 
more  realistic.  The  simulated  response  of  the  fifth  order 
model,  when  subjected  to  the  switching  times  calculated 
from  equations  (5)  and  (6)  and  the  parameters  from  the  first 
model,  is  shown  as  the  solid  line  in  Figure  6.  The  mani¬ 
pulated  variable  (steam)  is  held  at  the  upper  constraint 
until  C2  almost  reaches  the  desired  value  and  then  is  re¬ 
duced  to  the  lower  constraint  value  for  a  short  time  to  pre¬ 
vent  C 2  from  overshooting.  The  overshoot  is  reduced  from 
the  simulated  response  in  Figure  3«  The  steam  was  then  set 
to  the  value  equivalent  to  the  new  steady  state  (obtained 
from  the  model  using  non-linear  gain).  Note  that  the 
response  differs  slightly  from  the  ideal,  theoretical,  re¬ 
sponse  due  to  differences  between  the  second  order  model 
and  the  "process"  (I.e.,  fifth  order  model)  and  any  error 
in  picking  the  new  steady  state  value  for  the  steam. 

The  actual  process  response  using  switching  times  pre¬ 
calculated  based  on  model  3  is  shown  by  the  points  in 
Figure  6.  The  response  of  the  outlet  concentration,  C2,  is 
slower  than  that  of  the  model  (an  observation  supported  by 
other  data)  but  the  change  in  C2  from  one  steady  state  to 
another  is  smooth  and  fast.  The  process  response  using 
switching  times  based  on  model  2  are  plotted  In  Figure  5 
using  dashed  lines. 
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FIGURE  6a:  Responses  of  Concentration  and  Liquid  Levels 
for  Control  Based  on  Second  Order  Models 

model  l(sim), - model  2(exp.data) 

model  3  (exp.  data) 
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TIME  IN  MINUTES 

FIGURE  6b:  Responses  of  Flow  Rates  and  Temperature  for 
Control  Based  on  Second  Order  Models 

model  1  fsiml,  -  model  2  (exp), 

model  3  (exp) 


•  •  • 
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The  decrease  in  and  the  peaks  in  and  shown 
by  both  the  dotted  and  dashed  curves  in  Figure  6  are  due 
to  the  steam  remaining  too  long  at  the  lower  constraint 
before  returning  to  the  final  steady  state  value.  This  in 
turn  can  be  traced  directly  to  the  values  of  =  12  and 
Tj=7 .8  found  in  models  2  and  3  respectively  vs.  the  cal¬ 
culated  value  of  t  =1 .85.  This  emphasizes  the  importance 
of  "realistic"  models  rather  than  just  a  "good  fit"  to 
process  data. 

The  liquid  levels  were  under  tightly  tuned  conventional  control 
and  stayed  close  to  their  setpoints.  The  large  deviation 
in  W2  shown  by  the  dashed  curve  in  Figure  6  is  due  to  a 
failure  to  achieve  "bumpless"  transfer  back  to  the  conven¬ 
tional  P  and  I  averaging  control. 

Case  III:  Opt  j.rnal_Cont  rol__U  s  iQ2_Rea  1_-T  jrne_Sw  i  t  ch  _mg 

Bang-bang  control  switching  times  calculated  off-line 
are  not  always  satisfactory  due  to  modelling  errors  and/or 
real-time  factors  which  affect  the  process  response.  There¬ 
fore  two  methods  were  investigated  wh i ch  would  modify  the 
switching  times  based  on  the  actual  response(s)  of  the 
controlled  variables. 

(1)  Analytical  solution  of  the  optimal  switching 
curve . 

(2)  An  "intuitive"  or  empirical  method. 


165 


In  the  analytical  approach  and  dC^/dt  are  estimated 
based  on  actual  process  measurements  and  the  steam  is 
switched  when  the  actual  trajectory  in  the  phase  plane 
crosses  the  switching  curve.  Athans  and  Falb  [11]  present 
a  thorough  treatment  of  the  basis  for  this  approach.  It 
was  not  possible  to  implement  this  on  the  evaporator  be- 
cause  the  on-line  estimates  of  and  were  not  reliable 
enough.  The  simulated  results  in  Figure  7  show  that  the 
"real-time"  implementation  (solid  line)  moves  directly  to 
the  des i red  value,  whereas  the  results  based  on  switching 
times  calculated  a  priori  from  the  same  second  order  model 
(dashed  line)  show  that  the  steam  is  switched  too  late 
(thereby  causing  overshoot  in  C^)  and  then  remains  too 
long  at  the  lower  constraint  (thereby  causing  over¬ 
correct  ion  i n  C^)  • 

Method  one  is  ideal  if  an  on-line  computer  is  available 
to  implement  the  switching  and  if  satisfactory  estimates 
of  C2  and  can  be  obtained.  Flowever,  for  manual  imple¬ 
mentation,  the  following  method  is  more  convenient: 

(1)  calculate  the  optimal  switching  times  from 
equations  (5)  and  (6); 

(2)  simulate  the  response  of  the  system  and  determine 
the  value  of  the  controlled  variable  (C*)  at  the 
first  switching  time  and  the  length  of  time.  At, 
the  input  variable  is  at  the  lower  constraint 
(i.e.,  t^  - 


STEAM  FLOW  IN  LB/MfN  CONCN  IN  PC  GLYCOL 


1 66 


TIMES  IN  MINUTES 

Simulated  Responses  for  Real  Time  Switching 
Based  on  Second  Order  Model 
-  real-time,  ...  precalculated 


F  IGURE  7: 
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(3)  implement  the  procedure  experimentally 

S  -  Smax  at  1  "  0 

(b)  S  "*  Sm in  when  C2  =  C2 
(  c)  S  -4  Sg  after  At « 

The  experimental  results  of  Figure  8  and  9  show  that 
"real-time"  implementation  (solid  line)  moves  directly 
to  the  desired  value.  (Equivalent  open  and  closed  loop 
setpoint  changes  are  also  shown  for  comparison.)  However 
the  profiles  in  Figure  6  generated  from  pre-programmed 
control  exhibit  some  overshoot  and/or  undershoot  unless 
"tuned"  to  the  process. 

This  is  an  empirical  procedure  and  for  a  given  process 
can  undoubtedly  be  improved  with  experience.  It  must  be 
emphasized  that  similar  procedures  can  be  implemented 
stepwise  by  making  the  allowable  range  S  •  (  S  (  ^m3X  sma^I 

enough  to  guarantee  a  "safe"  response  and  by  switching  a 
little  early  if  there  is  any  doubt  about  the  time. 

Mylt  iyar|ab  l_e_Cont  rgl 

The  s  inlge- input-s ingle-output  procedures  used  in  Cases 
I,  II  and  III  are  simple  and  convenient  but  do  not  properly 
account  for: 

(1)  multivariable  processes 

(2)  interactions  between  process  variables 

(3)  physical  constraints  on  state  or  input  variables. 


I  H  jig 
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TIME  IN  MINUTES 

Experimental  Response  for  Real-l  ime  Switching 
Based  on  Second  Order  Model 

r  real-time,  DDC  feedback,  AAA  open-loop 


F  IGURE  8: 
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F  IGURE  9: 


Experimental  Response  for  Real-Time  Switching 
Based  on  Second  Order  Model 


rea 1 -t  ime 


-  DDC  feedback,  AAA  open-loop 
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For  example,  experience  with  the  evaporator  showed  that: 

1.  The  stream  from  the  first  to  the  second  effect  ( B  ^ ) 
has  almost  as  much  and  as  fast  an  effect  on  Cp  as 
the  steam,  S,  and  therefore  should  be  considered 
when  calculating  optimal  C0  t ra j ecto r  i  es . 

2.  Although  they  are  not  as  critical,  it  is  desired  to 
drive  and  Wp  as  well  as  Cp  to  their  new  steady 
state  values. 

3-  The  high  steam  flows  predicted  by  the  simpler  optimal 
control  formulations  cause  the  first  effect  to  over¬ 
pressurize  and  blow  the  safety  valve.  (This  was 
handled  in  the  previous  case  by  reducing  the  upper 
constraint  S  on  the  steam  flow  and  by  runninq  at 
a  feed  rate  of  4.5  lb/min  instead  of  the  usual  5*0. 
However,  it  is  a  trial  and  error  search  to  find  the 
correct  value  and  lowering  S  extends  the  process 
response  time).  Therefore  the  investigation  was  ex¬ 
tended  to  include  optimal  control  based  on  the  linear¬ 
ized  fifth  order  process  model  and  the  linear  pro¬ 
gramming  formulation  presented  earlier. 

Case  IV:  Mu  l_t  |va r yab  l_e  JDpt  hma  l__Con  t  rol__of  _Cp  _and_Wp 
Results  of  optimal  multivariable  state  driving  based 
on  a  fifth  order  linearized  model  are  shown  in  Figure  10. 
The  dashed  line  is  the  response  of  the  fifth  order  non¬ 
linear  model,  the  solid  line  is  from  the  response  of  the 
actual  process.  The  optimal  control  policy  is  calculated 
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TIME  IN  MINUTES 

FIGURE  70a:  Response  of  Concen t ra t  ion  and  Liquid  Levels 

for  Control  Based  on  Model  5L 1  (IP  -  W?,  C0) 

- exper imen ta 1 , - -  simulated 
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TIME  IN  MINUTES 

FIGURE  10b:  Response  of  Flow  Rates  and  Temperature  for 

Control  Based  on  Model  5L 1  (IP  -  W-j,  W2 ,  C2) 
-  experimental,  -  simulated 
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from  the  fifth  order  linear  model. 

The  controlled  variables  are  steam,  S,  product  from 
the  first  effect,  B j ,  and  product  from  the  second  effect, 

Bg .  The  steam  transient  includes  a  step  to  the  upper  steam 
constraint  at  time  zero,  a  step  down  to  a  lower  value  so 
that  the  process  will  not  violate  the  upper  limit  on  first 
effect  pressure,  (i.e.,  blow  the  safety  valve)  and  finally 
a  step  down  to  the  new  steady  state  value.  Note  that  within 
the  resolution  of  the  one  minute  time  interval  used  in  the 
numerical  optimization  calculations  there  is  no  step  down 
below  the  final  steady  state  value.  The  outlet  flow  B^ 
and  B^  are  also  switched  between  their  upper  and  lower 
constraints  to  return  the  liquid  levels  to  their  setpoint 
values  (only  Bj  is  plotted). 

The  concentration  trajectory  shown  in  Figure  10  is 
distinctly  different  than  in  Cases  I  through  III  because 
of  the  bang-bang  manipulation  of  B ^  and  B^  .  Note  particul¬ 
arly  that  the  initial  response  is  in  the  wrong  direction. 
However  -  in  spite  of  these  "anomalies"  the  overall  transient 
in  the  experimental  runs  is  better  (shorter)  than  for  the 
single  variable  cases  (ex.  Figure  6).  When  comparing  the 
actual  experimental  results  for  the  single  variable  and 
multivariable  cases  it  must  be  noted  that  the  first  and 
second  order  models  were  fitted  to  actual  experimental  re¬ 
sponses,  whereas  the  fifth  order  model  is  purely  theoretical. 
It  has  been  observed,  in  other  work,  that  the  response  of 
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the  fifth  order  model  leads  that  of  the  actual  process. 
Consequently  the  switching  times  calculated  using  this 
model  are  too  "early"  to  fit  the  actual  process  response. 

A  real-time  switching  scheme  such  as  was  simulated  in 
Case  Ml  would  definitely  be  of  advantage  here. 

At  the  end  of  the  state  driving  interval  the  variables 
were  put  back  onto  standard  feedback  control.  However  it 
was  found  desirable  to  put  the  liquid  levels  first  onto 
high  gain  or  "tight"  liquid  level  control  to  quickly 
eliminate  any  residual  error  present  after  the  state 
driving  interval.  The  process  was  eventually  returned  to 
the  averaging  P  and  I  control  of  liquid  levels  used  for 
normal  operations. 

The  same  problem  was  also  run  without  a  constraint  on 
the  first  effect  pressure  (actually  an  equivalent  constraint 
on  the  first  effect  temperature).  The  simulated  response 
(not  presented  here)  showed  the  steam  staying  at  the  upper 
constraint  instead  of  dropping  down  to  an  intermediate 
value  and  as  a  result  the  C 2  transient  was  significantly 
faster.  This  optimal  control  policy  could  not  be  imple¬ 
mented  on  the  evaporator  without  exceeding  the  physical 
limit  on  the  first  effect  pressure. 
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Case  V:  Mult  jvar  j.ab  l_e_0£t  jma  l__Cont  ro]__of  _Cg 

The  objective  in  Case  IV  was  to  drive  C^  and  the  two 
liquid  levels  to  the  new  steady  "state .  This  objective 
is  overly  severe  since  it  is  only  necessary  to  keep  the 
liquid  levels  within  reasonable  limits  rather  than  return 
them  exactly  to  their  setpoints. 

In  Case  V  the  1 iquid  level  performance  was  given  zero 
weight  in  the  objective  function  but  upper  and  lower  con¬ 
straints  were  placed  on  the  levels. 

The  experimental  (solid)  and  simulated  (dashed)  re¬ 
sults  are  shown  in  Figure  11.  The  steam  trajectory  is 
basically  similar  to  Case  IV  but  the  manipulation  of  and 
is  much  less  severe.  Theoretically  the  response  of  C^ 
should  be  better  than  in  Case  IV.  However  it  is  difficult 
to  see  any  difference  in  the  experimental  results. 

Once  again  the  switching  times  were  too  "early"  relative 
to  the  actual  process  response  and  could  be  improved 
s i gn i f i can  1 1 y  . 

This  ability  of  the  linear  programming  formulation  to 
handle  zero  weights  on  state  variables  is  very  important 
in  practical  applications  because  it  makes  it  very  easy  to 
handle  processes  where  some  of  the  state  variables  are  not 
directly  observable  and/or  are  not  controlled  variables. 

For  example  in  the  evaporator  model  the  concentration  out 
of  the  first  effect  is  a  state  variable  but  there  is  no 
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TIME  IN  MINUTES 

FIGURE  11b:  Response  of  Flow  Rates  and  Temperature  for 
Control  Based  on  Model  5L 1  ( IP  -  C2) 

-  experimental,  -  simulated 
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need  to  measure  it,  constrain  it  or  specify  a  final  steady 
state  value  for  it  when  formulating  the  optimal  control 
p  rob  1 em . 

7.  CONCLUS  IONS 

(1)  Optimal,  open-loop  state  driving  methods  implemented 
manually  or  by  computer  control  produced  significantly 
improved  responses  for  the  pilot  plant  evaporator  unit. 

(2)  The  linear  programming  formulation  of  the  optimal  con¬ 
trol  problem  is  flexible,  practical  and  permits  the 
direct  introduction  of  constraints  on  the  control  and/ 
or  state  variables.  It  is  also  applicable  where  all 

or  only  some  of  the  state  variables  are  of  interest 
( o r  measu rabl e)  . 

(3)  Optimal  control  of  the  evaporator  based  on  a  first 
order  fitted  model  was  better  than  conventional  methods 
but  higher  order  models  are  capable  of  even  better 
results  and  permit  direct  introduction  of  constraints. 
The  "fjtted"  models  in' general  produced  better  results 
than  the  purely  theoretical  models. 

(4)  Combination  of  the  optimal  mul t ivar iable  control  tech¬ 
niques  with  conventional  direct  digit  ?  a  1  control  of 
the  pilot  plant  worked  successfully  and  permitted 
improvements  that  were  not  practical  when  either  was 


used  alone. 
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(5)  If  real-time  measurements  of  the  controlled  variables 
are  available  then  the  switching  times  can  be  cal¬ 
culated  or  adjusted,  to  compensate  for  differences 
between  the  model  and  the  process  response. 


CHAPTER  F  IVE 


OPTIMAL  STATE  DRIVING  CONTROL  TECHNIQUES 
COMBINED  WITH  CONVENTIONAL  REGULATORY  SYSTEMS: 
AN  EXPERIMENTAL  EVALUATION 


ABSTRACT 


Optima],  multivariable,  state-driving  control  techniques 
were  developed  and  implemented  on  a  computer  controlled  eva¬ 
porator  pilot  plant  at  the  University  of  Alberta.  The 
optimal  control  problem  was  formulated  using  a  state  differ¬ 
ence  equation  model  of  the  process  and  linear  performance 
indices,  including  minimum  time  and  sum-of-the-abso 1 ute 
errors,  so  that  standard  linear  programming  techniques  could 
be  ut  i  1 i zed . 

A  method  of  adding  the  control  policy  developed  from 
optimal  state-dr iv  ing  techniques  to  a  conventional  feedback, 
regulatory  control  system  was  developed  which  simplifies  the 
optimal  control  calculations,  facilities  implementation  and, 
where  possible  uses  the  feedback  action  to  compensate  for 
modelling  errors  and  disturbances. 

Experimental  and  simulated  results  showed  that  the  use 
of  different  criteria  produced  significantly  di fferent'  pro¬ 
cess  transients  and  that  constraints  on  the  control  and/or 
state  variables  can  be  incorporated  to  guarantee  practical. 
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physically  realizable  control  policies.  The  experimental 
results  also  showed  that,  although  they  are  sensitive  to 
model  accuracy,  optimal  mu  1 1  i  va r  i  ab 1 e ,  state-driving  control 
policies  produce  significantly  faster  setpoint  changes  than 
conventional  methods.  The  method  used  to  combine 

state-driving  and  regulatory  control  policies  was  practical 
and  produced  better  results  than  either  used  alone. 
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1  •  INTRO  DUCT  ION 

The  purpose  of  this  work  was  to  develop*  implement  and 
evaluate  optimal  s tate-dr i v  ing  control  techn  iques that  would 
be  suitable  for  use  on  industrial  processes.  A  double¬ 
effect*  pilot  plant  sized  evaporator  located  in  the  Department 
of  Chemical  and  Petroleum  Engineering  at  the  University  of 
Alberta  was  selected  for  the  experimental  studies  because 
of  the  large  amount  of  information  available  from  previous 
investigations  and  the  fact  that  the  unit  was  also  inter¬ 
faced  to  an  IBM  1800  digital  computer  which  could  be  used 
to  facilitate  data  acquisition  and  implementation  of  more 
soph  i  s tocated  control  policies. 

Several  techniques  exist  to  calculate  optimal  control 
policies  [1],  The  evaluation  of  these  control  policies  by 
simulations  using  the  control  model  results  in  dramatic 
improvements  over  conventional  methods.  However*  when  the 
objective  is  practical  implementation  on  a  real  process  then 
a  number  of  additional  factors*  including  the  following* 
must  be  included: 

(1)  formulation  of  the  problem 

(a)  Model:  What  complexity  is  requ i red  and  how 
sensitive  is  the  optimal  process  response 

to  modelling  errors?  What  process  variables 
should  be  included  in  the  model? 

(b)  Algorithm:  The  dynamic  optimization  algorithm 
should  be  able  to  handle  a  wide  range  of  pro¬ 
blems  and  to  incorporate  constraints  on  the 
state  and  control  variables. 
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(c)  Criteria:  Since  a  single  criterion  is  un- 
likely  to  be  suitable  for  all  potential 
app 1  i cat  ions ,  the  control  engineer  should 
have  a  choice  of  criteria  and  some  indication 
of  the  influence  of  the  criteria  on  the 
final  process  response. 

(2)  combination  of  the  optimal  policy  with  existing 
regulatory  controls 

Since  most  optimal  design  procedures  deal 
only  with  the  control  action  needed  to  drive  a 
process  from  its  existing  state  to  the  desired 
state,  the  designer  is  frequently  faced  with  the 
problem  of  how  to  combine  the  optimal  state 
driving  control  policy  with  a  separate  regulatory 
control  system.  This  problem  is  particularly 
relevant  to  existing  processes,  whether  they  are 
controlled  by  conventional  or  "optimal"  regulatory 
systems.  Modelling  errors  and  unexpected  dis¬ 
turbances  must  be  anticipated  and  accommodated  and 
the  extra  mathematical  complexities  involved 
with  using  closed,  versus  open,  loop  models  must 
be  recogn  i zed . 

These  points  and  others,  as  they  apply  to  the  imple¬ 


mentation  of  optimal  state  driving  control  techniques  on 
a  pilot  plant  evaporator,  are  considered  in  the  following 
sect  ions . 
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2  •  L  ITERATIVE  REV  I  EW 

In  the. optimal  control  literature  emphasis  has  been 
placed  on  the  quadratic  and  time  optimal  performance  cri¬ 
teria  because  of  the  convenience  of  mathematical  analysis. 

For  single  loop  servomechanism  applications  Latour 
et  al  [2]  have  presented  analytical  expressions  for  the  time 
optimal  switching  times  for  overdamped  systems  represented 
by  a  second  order  transfer  function  with  a  time  delay. 

They  report  that  this  method  results  in  significantly  better 
performance  than  that  obtained  using  a  well  tuned  PID 
controller  and  that  the  improvement  increases  with  the 
magnitude  of  the  setpoint  change  [2].  However  more  sophis¬ 
ticated  methods  are  required  for  multivariable  applications. 

The  two  most  popular  approaches  for  determining  the 
optimal  control  policies  of  multivariable  systems  have  been 
dynamic  programming  and  Pontryagin's  Maximum  Principle  [3]. 
Numerical  solution  [1]  using  search  techniques,  quasilinear¬ 
ization  or  invariant  imbedding  is  usually  required.  These 
methods  produce  excellent  results  but  often  encounter  numer¬ 
ical  or  dimensionality  problems  in  real  applications  and  are 
not  easily  adapted  to  constrained  systems.  Tabak  [4]  re¬ 
views  the  application  of  mathematical  programming  techniques 
in  optimal  control  theory.  A  linear  programming  formulation 
offers  the  advantage  of  being  able  to  handle  large  multi- 
variable  systems  with  constraints  on  the  control  and/or  state 
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variables  and  is  the  only  approach  presented  in  this  work. 
Zadeh  and  Whalen  [5]  first  showed  that  the  time  and  fuel 
optimal  control  problems  could  be  reduced  to  1  inear  pro¬ 
gramming  problems  for  linear  discrete  t ime-  i  nva r ian t 
systems.  Bondarenko  and  Filimonov  [6]  present  numerical 
results  using  these  critieria.  In  the  Chemical  Engineering 
literature.  Lesser  and  Lapidus  [7]  performed  a  numerical 
study  using  linear  programming  of  the  time  optimal  control 
of  an  absorber  described  by  six  first  order  linear  ordinary 
differential  equations. 

Little  work  has  been  reported  on  the  use  of  linear 
programming  techniques  with  criteria  other  than  time  and 
fuel  optimal  performance  indicies.  Lack  and  Enns  [8]  for¬ 
mulate  a  minimax  criterion  as  a  1  inear  programming  problem 
and  compute  the  optimal  control  of  a  model  of  a  nuclear 
reactor  with  twenty-one  state  variables.  P ropo  i  [9]  pre¬ 
sents  a  numerical  example  involving  calculation  of  the 
optimal  control  policy  of  an  overdamped  system  with  minimi¬ 
zation  of  the  transient  response  area  as  a  criterion.  This 
is  equivalent  to  minimization  of  the  sum  of  the  absolute 
value  of  the  error  at  all  the  sampling  instants  since  there 
is  no  overshoot.  Lo rch  i  rachoonku 1  and  Pierre  [10]  use  a 
criterion  whereby  the  absolute  values  of  the  errors  are 
weighted  in  both  time  and  space  for  mu  1 1  i  va r  i  ab 1 e  distributed- 
parameter  sampled-data  systems. 
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Constraints  on  the  control  vector  are  particulary 
easy  to  incorporate  into  the  linear  programming  formulation. 
However  state  variable  constraints  are  much  more  cumbersome. 
Lesser  and  Lapidus  indicate  how  state  variable  constraints 
may  be  introduced  however  only  control  constraints  were 
used  in  their  numerical  analysis. 

State  and  control  variable  constraints  were  used  in 
Chapter  Four  which  dealt  with  the  dynamic  optimization  of 
the  open-loop  response  of  state  space  model  of  the  pilot- 
plant  evaporator  at  the  University  of  Alberta  using  a  time 
optimal  criterion  and  standard  linear  programming  tech¬ 
niques. 

3 .  FORMULATION  OF  THE  OPTIMAL  CONTROL  PROBLEM 

An  optimal  control  problem  involves  development  of  a 
suitable  process  model  plus  selection  of  an  optimization 
algorithm  and  performance  criterion.  These  will  be  dis¬ 
cussed  in  the  following  subsections. 

3 . 1  Mode  1 

Although  linearization  about  nominal  process  values  may 
be  requ i red^mos t  mu  1 1 i va r  iab 1 e  processes  may  be  adequately 
represented  by  the  following  linear,  t ime- i nva r ia nt ,  state 
space  mode  1 : 
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x(  t)  =  A  x(t)  +  _B  _u(  t) 


(i) 


The  optima]  control  problem  may  be  stated  as  the  determina¬ 
tion  of  the  trajectories  of  the  control  vector,  _u(t),  needed 
to  drive  the  system  from  its  initial  state,  x(0),  to  the 
desired  state,  x^,  while  minimizing  a  particular  objective 
function.  It  is  assumed  that  the  system  as  defined  by 
equation  (1)  is  state  controllable. 

3 • 2  Optimization  Algorithm 

Linear  programming  which  is  familiar  to  the  process 
industries  from  other  applications  was  selected  as  the  opti¬ 
mization  algorithm  and  the  problem  was  formulated  as 
fo 1  lows  . 

Assuming  that  the  control  vector,  _u(t),  is  constant 
over  the  sampling  interval,  T,  the  analytical  solution  to 
equation  (1)  can  be  written  in  discrete  form  as: 


(2) 


x( k  +  1 )  =  2i(  k)  +  A  _u(  k) 


where  and  A  are  constant  coefficient  matrices  determined 
by  standard  techniques  [11]. 

Repeated  use  of  equation  (2)  leads  to  the  following 
sets  of  equations  wh  i  ch  permit  the  calculation  of  the  state 
vector  at  each  time  interval  in  terms  of  the  initial  state 
vector  and  previous  values  of  the  control  variables: 
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x(  1)  =  ±  x ( 0)  +  A  jj(0) 

2<(2)  =  J>2x(0)  +  u(0)  +  A  u(l)  (3) 

•  • 

•  • 

•  • 

x(N)  =  _/x(0)  +  /"’'A  u(0)  +  ...  +  A  u(N-l) 

This  set  of  linear  algebraic  equations  in  conjunction  with 
a  linear  performance  index  allows  the  use  of  standard 
1  inear  programming  techniques  for  solution  of  the  optimal 
control  problem. 

3 .3  Performance  Criteria 

Different  criteria  can  result  in  s  i  gn  i  f  i  can 1 1 y  different 
responses  and  to  date  no  one  criterion  or  objective  function 
has  proven  acceptable  in  all  situations. 

3.1.1  Single  Point  Criteria 

Performance  indices  that  have  been  used  extensively  in 
control  system  design,  particularly  for  single  output  systems, 
include  "time  optimal",  "minimax",  and  combinations  of  spec¬ 
ifications  such  as  percent  overshoot  and  settle-out  time. 

The  computational  problem  encountered  in  derivation  of 
the  time  optimal  control  policy  is  to  determine  the  minimum 
number  of  control  intervals,  N,  within  which  the  system  can 
be  driven  to  the  desired  steady  state  subject  to  any  control 
or  state  variable  constraints.  This  formulation  and  some  of 
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the  computational  aspects  were  discussed  in  Chapter  Four. 

The  formulation  is  one  in  which  only  deviations  of  the  state 
from  the  des  i  red  state  at  terminal  time,  Xj(N)  -  xQ-;>  are 
of  interest.  The  solution  involves  assuming  a  value  for  N 
and  minimizing  the  maximum  weighted  deviation,  X 3  at  time  N .T . 

This  procedure  is  repeated  using  successively  smaller 
values  of  N  until  X  can  no  longer  be  reduced  below  the  limit 
specified  by  the  user. 

The  minimax  criterion  requ  i  res  that  this  minimum  displace¬ 
ment  of  the  state  vector  from  an  undesirable  set  of  states, 
be  maximized.  This  results  in  a  linear  programming  problem 
similar  to  one  iteration  of  the  time  optimal  case  except 
that  all  points  in  the  state  vector  trajectory  are  considered 
in  the  objective  function  instead  of  just  the  terminal 
va  1  ues . 

A  combination  of  spec  i  f  i  cat  ions  which  is  popular  in 
process  control  is  minimization  of  the  rise  time  subject 
to  limitations  on  the  amount  of  overshoot  and  a  specification 
on  settle-out  time.  The  minimum  rise  time  can  be  accomplished 
in  linear  programming  formulation  by  minimizing  the 
(weighted)  displacement  of  the  state  vector  from  its  desired 
value  at  some  selected  point  which  tails  in  the  interval 
between  the  start  of  the  transient  and  the  time  at  which  any 
element  of  the  state  vector  first  equals  the  desired  value. 

The  limits  on  the  overshoot  (and  subsequent  "undershoots") 
are  handled  by  state  constraints  applied  for  intermediate 
values  of  time,  and  the  settle-out  time  is  forced  by  tighter 
state  constraints  specified  at  later  values  of  time. 
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Thus  it  can  be  seen  that  the  linear  programming 
approach  permits  one  formulation  to  handle  all  three 
criteria.  The  only  difference  is  in  the  weighting  factors 
assigned  to  the  deviations  of  the  state  variables  from 
their  desired  values  at  different  sampling  instants. 

3 . 3 • 2  Integral  Criteria 

Most  modern  design  methods  for  optimal  control  of 
multivariable  systems  utilize  a  performance  Index  of  the 
fo 1  lowing  form: 


(*) 


dt 


J 


0 


In  conventional  design  methods  the  integral  of  the 
absolute  error  ( IAE)  index  and  the  closely  related  inte¬ 
gral  of  time  multiplied  by  the  absolute  error  (ITAE)  index 
are  popular  linear  integral  criteria.  The  equivalent 
sampled-data  criteria  are  the  sum  of  the  absolute  errors 
(SAE)  and  sum  of  the  absolute  error  times  the  time  (STAE) 
indices.  The  criteria  for  the  optimal  control  problem 
would  then  be  to  minimize,  Z: 


N  n 


Z 


(5) 


19) 


where  cu.(k)  is  the  weighting  factor  assigned  to  the  i*^ 
state  variable  at  the  k^  sampling  instant.  For  the  STAE 
index  uuj(k)  could  simply  be  k.  If  only  cu.(N),  i  =  1,  2,  ... 
n ,  is  nonzero  then  this  results  in  the  time  optimal  con¬ 
trol  problem  which  can  be  solved  by  iteration  using 
successively  smaller  values  of  N. 

Equation  (5)  may  be  easily  transformed  into  the 
fo 1 1 ow  ing  form  which  is  more  comp at iblewith  linear  pro- 
g  ramm ing: 


Z  =  I  I  w.(k)  (e  (k)  +  e  ,(k))  (6) 

k= i  i  =  l  1  ^  1 

where  e^;(k)  =  (k)  -  x.(k)  when  the  displacement  is 

pos  i  t  i  ve  and 

is  negative.  Using  equation  (3)  the  linear  programming 
problem  is  to  minimize  the  performance  index,  Z,  as  de¬ 
fined  by  equation  (6)  subject  to  the  linear  constraint 
equations  of  equation  (9)  where  for  all  k  =  1,  2,  ...  ,  N: 

u_L  £  jj(k)  £  uy  (7) 


(k)  =  x^  (k)  -  Xj(k)  when  the  displacement 

u  i 


l,(K),€2(k)  a  0 


(8) 
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3-3-3  State  Variable  Weighting  and  Constraints 
Control  constraints  are  mandatory  for  most  practical 
problems.  Constraints  in  the  form  of  equation  (7)  may  be 
added  directly  to  the  linear  program  without  increasing 
the  size  of  the  basis  [12].  In  order  that  the  model 
response  be  tailored  to  the  process  engineer's  specif¬ 
ications,  provision  must  be  made  for  state  variable  con¬ 
straints  and  unequal  state  variable  weighting.  State  con¬ 
straints  may  be  easily  added  to  equation  (8)  by  simply 
putting  upper  limits  on  e^.(k)  and  e  . (k).  This  does  not 
result  in  a  significant  increase  in  execution  time  as 
stated  above  with  reference  to  the  control  constraints. 

Addition  of  state  constraints  to  the  time  optimal  cri¬ 
teria,  by  contrast,  results  in  increased  execution  time  due 
to  the  number  of  rows  in  the  linear  programming  problem 
as  indicated  in  Chapter  Four. 

Constraints  on  the  derivatives  of  the  state  may  also  be 
added  through  a  finite  difference  approximation.  This  is 
useful  for  removing  inter-sampling  ripple  [10]  and  imple¬ 
menting  constraints  on  maximum  allowable  rates  of  change  so 
as  to  "ease"  into  optimal  control. 
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3-3-4  Computat iona 1  Aspects 

When  a  linear  programming  problem  contains  more 
variables  than  rows,  solution  of  the  dual  problem  is  more 
efficient.  Th i s  concept  can  be  utilized  in  the  solution  of 
the  time  optimal  formulation  if  the  number  of  state  con¬ 
straints  is  not  large.  It  results  in  a  significant  saving 
in  computer  time.  However  examination  of  the  dimensions 
of  equation  (9),  which  are  (N.n)  x  (n.m  +  2  N.n),  indicates 
the  primal  solution  is  more  efficient  since  the  number 
of  rows  is  less  than  the  number  of  columns. 

4 .  COMPARISON  OF  CRITERIA  -  A  NUMERICAL  EXAMPLE 

Lesser  and  Lapidus  [7]  used  linear  programming  to 
determine  the  time  optimal  control  for  the  six  plate  ab¬ 
sorber  shown  in  Figure  1.  The  inlet  concentrations  were 
used  as  control  variables  in  order  to  maintain  linearity 
but  they  were  constrained  so  as  to  constrain  concentrations 
to  a  f eas  ib 1 e  range . 

Material  balances  around  each  plate  combined  with  a 
linear  equilibrium  relationship  result  in  a  linear  vector 
differential  equation  identical  in  form  to  equation  (1) 
where  '  [7  ]: 
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FIGURE  1:  Schematic  of  Gas  Absorber  System 
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0.6341 


(11) 


is  normalized  such  that: 


[-0.0306  -0.0568  -0.0788  -0.0977  -0.1138  -0. 
0 

[0  -0.1389] 

0 

£  1  .0 

<  u2  ^  0.972 


1273] 
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where  the  control  variables  are  defined  as 


u 


x 


o 


u, 


0.72 


Xr  -0.4)67 


(12) 


In  Figure  2  the  response  (for  a  sample  time  of  one- 
half  minute)  is  compared  for  time  optimal,  SAE  and  the 
combination  criteria.  Note  that,  although  the  time  optimal 
criterion  is  the  only  one  which  forced  all  the  state  varia¬ 
bles  to  the  new  steady  state  in  six  minutes,  the  latter 
criteria  yield  "smoother"  trajectories  than  does  the  time 
optimal  criterion.  These  control  policies  are  not  unique 
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The  two  SAE  trajectories  in  Figures  2  and  3  result 


from  formulations  differing  only  in  state  variable  weighting 
(equal  weighting  for  all  state  variables  (SAE1)  versus  the 
same  weighting  for  all  state  variables  except  the  product 
concent  rat  ion  which  is  weighted  ten  times  the  others  (SAE2)). 

It  is  of  interest  to  examine  the  trajectories  of  the 
intermediate  compositions  as  well.  Figure  3  shows  the  tra¬ 
jectories  for  x^  for  the  same  three  criteria.  The  inter¬ 
mediate  trajectories  in  the  combination  criteria  were  not 
included  in  the  objective  function  however  the  deviation 
from  their  desired  steady  state  value  was  constrained.  Note 
that  the  time  optimal  trajectory  could  be  tailored  to  a  more 
acceptable  response  through  the  use  of  state  constraints  on 
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This  numerical  example  indicates  the  significant 
difference  in  response  which  may  result  from  different 
criteria.  The  "best"  choice  of  a  performance  index  depends 
on  the  particular  application.  Through  the  use  of  linear 
programming  techniques  described  in  this  work  the  process 
response  may  be  tailored  to  desired  specification  by  choice 
of  criteria,  addition  of  constraints  and  assignment  of 
weighting  factors  to  the  state  vector.  Unfortunately 
design  rules  to  generate  weighting  factors  to  produce  a 
desired  response  are  difficult  to  formulate  and  are  usually 
chosen  by  experience. 


5. 


INTERFACING  AN  OPTIMAL  CONTROL  SYSTEM  TO  A 
CONVENTIONAL  CLOSED  LOOP  CONTROL  SCHEME 


Open  loop  imp  1 ementat  ion  of  the  optimal  control  law 
can  be  used  but  modelling  errors  and  disturbances  may  result 
in  an  offset  from  the  desired  condition.  Some  of  these 
difficulties  can  be  overcome  by  performing  the  setpoint 
changes  under  closed-loop  control  [14]  by  direct  introduction 
of  the  step  changes  into  the  setpoints  of  loops  "tuned"  for 
the  servomechanism  problem.  "Optimal"  techniques  require 
a  model  of  the  closed  loop  process  which  is  more  complicated 
than  the  open  loop  model  because  the  elements  of  the  control 
loop  must  be  included.  Locatelli  and  Rinaldi  [15]  discuss 
criteria  for  choosing  between  closed  and  open  loop  implement¬ 
ation  of  optimal  control.  Only  in  special  cases  can  a  rat¬ 
ional  a  priori  choice  be  made  between  the  approaches. 


£ 
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The  approach  adopted  in  this  work  is  to  utilize  the 
much  simpler  open  loop  model  to  derive  the  control  law  and 
to  compensate  for  modelling  errors  or  unsuspected  load 
disturbances  by  interfacing  the  open  loop  control  policy 
to  the  closed  loop  system  in  the  manner  represented 
schematically  in  Figure  4.  When  there  is  a  priori  know¬ 
ledge  of  the  nature,  magnitude  and  time  of  the  upset,  load 
disturbances  may  be  included  in  the  model  and  compensated 
for  by  open-loop  action.  In  the  proposed  approach  the  con¬ 
ventional  feedback  loop  is  not  opened  during  the  setpoint 
change  but  rather  the  predicted  optimal  state  trajectories 
are  feed  to  the  setpoints  of  the  corresponding  control 
loops.  Bumpless  transfer  can  be  effected  at  the  beginning 
and  end  of  each  transient.  If  the  process  response,  x,  and  . 
the  optimal  response,  x*,  are  identical  the  feedback  control 
action,  _u  ,  will  be  zero  and  the  change  in  operating  state 
will  proceed  in  a  fashion  identical  to  the  optimal  open-loop 
implementation.  In  the  presence  of  disturbances  or  model 
inaccuracies  the  control  law  is  no  longer  optimal.  However 
deviations  from  the  calculated  trajectory  will  be  compensated 
for  by  the  feedback  control  loops.  Since  the  optimal  state 
trajectory  approaches  the  desired  state  at  final  time  the 
system  automatically  returns  to  regulatory  control. 
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FIGURE  4:  Addition  of  Open-Loop  Optimal  Control  Policy 
to  Existing  Regulatory  Control  Scheme 
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6 .  IMPLEMENTATION  ON  A  DOUBLE  EFFECT  EVAPORATOR  SYSTEM 

6 . 1  Process  Description  and  Modelling 

The  optimal  control  techniques  developed  in  previous 
sections  were  implemented  on  a  pilot  plant  double  effect 
evaporator  equipped  with  conventional  i nst rumentat  ion .  The 
measurement  transducers  and  final  control  elements  are  inter 
faced  to  an  IBM  1800  control  computer  which  has  a  DDC 
monitor  system.  The  process  computer  was  used  to  facilitate 
data  acqu  i  s  i  t  ion  and  reduct  ion  and  implementation  of  optimal 
control.  The  process  and  computer  configuration  are  dis¬ 
cussed  in  more  detail  in  Appendix  A.  As  indicated  in 
Figure  5?  the  three  major  control  loops  of  the  evaporator 
are  cascade  control  loops.  The  bottom  flow  rates  from 
each  effect  are  manipulated  to  control  the  respective  liquid 
levels  and  .the  steam  rate  is  manipulated  to  control  the 
product  concentration. 

For  modelling  purposes  the  evaporator  can  be  considered 
as  two,  lumped  parameter  f  i  rst  order  systems  in  series. 
Neglecting  steam  chest,  vapor  space  and  tube  wall  dynamics, 
mass,  heat  and  component  balances  around  each  effect  result 
in  six  nonlinear  ordinary  differential  equations  C 1 6 ] . 
However,  energy  accumulation  in  the  second  effect  can  be 
neglected  since  the  pressure,  and  hence  temperature,  is 
tightly  controlled.  The  resulting  set  of  five  nonlinear 
differential  equations  is  discussed  in  Appendix  C  (model  5NL) 
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Model  5NL  exhibited  a  significant  lead  time  when  com¬ 
pared  to  the  actual  process  response.  Refer  to  Figure  2, 
Chapter  Three.  Since,  as  demonstrated  in  Chapter  Four, 
an  accurate  model  is  necessary  for  open-loop  state  driving, 
the  five  equation  nonlinear  model  was  fitted  to  experimental 
data  representing  the  process  response  to  step  changes  in 
the  steam  rate.  The  fitted  model  (model  5NLF)  exhibited 
considerably  less  lead  than  the  theoretical  model.  Refer 
to  F igure  2,  Chapter  Three.  Details  of  the  algorithm 
employed  and  problems  encountered  are  related  in  Chapter 
Th  ree . 

The  fifth  order  nonlinear  models,  models  5NL  and  5N LF , 
were  then  linearized  about  nominal  process  values  and  put 
in  the  standard  state  space  form  of  equation  (1).  The  re¬ 
sults  are  summarized  in  Appendix  C.  The  linear  models  are 
referred  to  as  models  5L  and  5LF  respectively. 

The  effect  of  improving  the  model  accuracy  by  fitting 
the  model  to  experimental  data  and  the  selection  of  the 
point  to  linearize  about,  are  treated  in  subsections  6.3 
and  6.4. 

6.2  Mode  1  Reduct  ion 

Since  the  variable  of  interest  is  the  product  concentra¬ 
tion,  "optimal"  single  loop  control  may  be  implemented  by 
manipulating  steam  flow  while  the  liquid  level  loops  are  put 
under  tight  control  as  presented  in  Chapter  Four.  A  second 
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order  state  equation,  more  commonly  represented  in  the  form 
of  a  transfer  function  of  equation  (13),  can  be  used  to 
approximate  the  relationship  between  steam  rate  changes 
and  product  concentration  response: 

C2(s)  K  exp  (-  t  (s)) 

~SJT)  -  (T,s+iy(72s+-iy  O3) 

However  as  demonstrated  in  Chapter  Four,  a  "good"  fit  of 
this  model  to  process  data  does  not  ensure  good  performance 
as  a  cont  ro 1  mode  1 . 

Table  1  summarizes  some  model  parameters  which  will  be 
utilized  in  subsequent  sections. 


TABLE  1 

Various  Model  Parameters 


T 

d 

T, 

T 

2 

K 

P 

USED  IN 

F  IGURE 

Model  1 

0 

10 

20 

non  1  i  nea r 
ga  i n* 

11,12 

Model  2 

0 

1  .85 

29 

non  1  i  nea  r 
ga  i n** 

Model  3 

0 

1  .85 

44 

non  1  i  nea  r 
ga  i  n* 

6,15,16 

*  App 

**  K  = 

>en  d  ix 

^ 0.0975 

1 ,  Chapter 

used  in  F 

Th  ree 

igure  13 

The  parameters  for  model  1  were  chosen  arbitrarily  to  give 
poor  agreement;  those  for  model  2  were  fitted  to  the  model  response 
and  those  for  model  3  to  experimental  data. 
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6 . 3  Evaluation  of  Theoretical  and  Fitted  Models 

In  th  i.s  section  the  performance  of  the  theoretical  and 
the  fitted  linear  models  will  be  evaluated  using  open-loop 
implementation  so  that  feedback  does  not  distort  the  effect 
of  va r  ?ous  mode  1 s . 

The  control  policies  were  implemented  on  the  evaporator 
under  program  control  synchronized  with  the  DDC  monitor. 

The  three  major  control  loops,  as  per  Figure  5>  are  cascade 
control  loops.  During  open-loop  state  driving  the  master 
loops  were  put  on  manual  and  the  setpoints  of  the  slave 
loops  were  provided  by  a  control  program  [17].  A  control 
transfer  was  then  performed  automatically  at  the  end  of  the 
transient  and  the  master  loop  reactivated  [17]- 

The  time  optimal  c  r  i  t  e  r  Ian  was  investigated  first  since 
it  is  practical  and  realistic.  Since  the  product  concentra¬ 
tion  is  of  p r  i  me  concern,  the  other  state  variables  were  not 
included  in  the  time  optimal  criteria.  Rather  the  holdups 
were  constrained  to  within  5*0  lbs  of  the  steady  state 
holdups  and  the  first  effect  temperature  was  limited  to  the 
region  less  than  240°F .  The  first  effect  concentration  is 
inherently  constrained. 

All  setpoint  changes  are  changes  of  two  percent  by 
weight  in  the  product  concentration  (eg.  from  9*0  to  11.0 
percent  g 1 yco 1 ) . 
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6.3-1  Control  During  State  Driving  (o  (  t  (  t^) 

Figure  6  shows  clearly  how  the  response  of  the 
theoretical  model,  (5L),  (dashed  line)  leads  the  process 
response  (solid  line).  At  the  time  the  model  response 
reaches  the  desired  value  the  process  has  attained  only 
sixty-five  percent  of  the  desired  setpoint  change.  An 
intuitive  way  of  looking  at  the  discrepancy  between  the 
process  and  the  model  in  Figure  6  is  to  regard  the  final 
switch  line  (arrow)  to  be  approximately  three  minutes  in 
error.  With  the  rapid  rate  of  change  of  product  concentra¬ 
tion  this  results  in  a  large  response  error  (approximately 
thirty-five  percent). 

From  an  intuitive  point  of  view  the  optimal  control 
policy  for  this  problem  of  increasing  the  product  con¬ 
centration  is  to: 

(1)  maximize  the  steam  flow  so  as  to  maximize  the 
boil  off  of  water 

(2)  minimize  the  bottoms  flow  from  the  first  effect 
which  reduces  the  dilution  of  by  B  ^ 

(3)  lower  the  second  effect  level  to  reduce  the 
holdup  and  permit  faster  response. 

These  actions  are  evident  in  Figure  6  but  are  complicated  by 
the  state  constraints.  The  steam  flow  increases  to  its  maxi¬ 
mum  value  and  is  almost  immediately  reduced  to  about  2.4 
pounds  per  minute  to  avoid  violating  the  constraint  on  T^. 

The  levels  perform  as  expected  as  can  be  seen  from  Figure  6. 
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FIGURE  6b:  Response  of  Flow  Rates  and  Temperature  for 
Time  Optimal  Control 

-  model  5L ,  -  experimental,  Model  5L 
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The  constraints  on  the  levels  are  represented  by  the  hori¬ 
zontal  solid  lines  with  the  solid  arrows.  The  and 
control  policies  are  not  easily  interpreted  and  are  not 
un  i que . 

The  dotted  curve  in  Figure  6a  i s  the  experimental  pro¬ 
cess  response  produced  from  the  time  optimal  control  policy 
derived  from  model  3  of  Table  1.  The  rate  of  increase  of 
C2  under  the  two  different  policies  clearly  shows  the  advan¬ 
tages  of  using  the  mu  1 1 i va r i ab 1 e  approach.  Since  all 
simulated  (from  360  CSMP)  and  experimental  data  was  recorded 
at  one  point  per  minute,  and  since  these  points  were  plotted 
on  a  calcomp  plotter,  some  peaks  are  diminished  and  step 
changes  take  on  a  ramp  like  appearance.  For  example  the 
initial  spike  in  the  steam  response  of  Figure  6b  is  much 
reduced.  Another  contributing  factor  to  this  plot  character¬ 
istic  is  the  finite  response  time  of  the  actual  process 
variables. 

The  response  displayed  in  Figure  7  is  the  result  of  the 
linearized  model  5LF  which  was  obtained  from  the  nonlinear 
model,  5NLF,  fitted  to  the  open-loop  response  of  the  pro¬ 
cess  to  step  changes  in  steam  flow  rate.  Chapter  Three  de¬ 
tails  the  results  and  procedure.  Since  the  model  more 
closely  represents  the  process,  better  control  is  achieved. 
This  can  be  seen  from  the  reduced  response  error  in  the 
product  concent ra t  ion ,  approximately  fifteen  percent  in 
Figure  7  compared  to  thirty'-five  in  Figure  6.  The  dashed 
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FIGURE  7a:  Response  of  Concentration  and  Liquid  Levels 

for  Time  Optimal  Control 

- experimental,  Model  5LF ,  -  experimental 
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FIGURE  7b:  Response  of  Flow  Rates  and  Temperature  for 
T ime  Opt  ima 1  Control 

- experimental.  Model  5LF ,  -  Model  5LF 
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curve  in  Figure  7  is  the  response  of  from  Figure  6  re¬ 
plotted  for  convenience.  The  model  response  of  T  dashed 
line  in  Figure  7b,  more  closely  approximates  the  process 
response  than  in  Figure  6b.  A  similar  improvement  in  the 
modelling  accuracy,  model  3,  Table  1  was  obtained  by  experi¬ 
mentally  "tuning"  the  second  order  model,  model  2,  Table  1, 
fitted  to  the  theoretical  five  equation  nonlinear  model. 

Model  3  produces  a  satisfactory  process  response  as  indicated 
by  the  dotted  curve  in  Figure  6.  Model  2  had  a  large 
switching  error  of  about  ten  minutes.  This  is  indicated 
by  the  large  discrepancy  in  between  models  2  and  3« 

In  general  fitted  models  perform  better  than  theoretical 
models.  The  multivariable  model  could  be  improved  by  fitting 
it  to  process  responses  such  as  those  of  Figures  6  and  7 
instead  of  to  open-loop  responses  to  steam  steps. 


6.3  -  2  Control  After  State  Driving  (t  )  t^) 

The  time  optimal  policy  stops  at  the  time  the  desired 
state  is  reached.  Since  Wj  and  are  not  driven  to  their 
desired  steady  states,  the  regulatory  control  strategy  re¬ 
stores  liquid  level  status.  Averaging  level  control  is  used 
normally  and  as  a  result  the  offsets  in  levels  remaining  after 
conclusion  of  state  driving  were  very  slowly  eliminated. 

Refer  to  Figure  6 . 
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A  strategy  was  devised  for  more  rapid  level  response 
whereby  the  bottom  flow  rates  were  set  to  their  predicted 
steady  state  value  plus  or  minus  the  equivalent  of  propor¬ 
tional  action  with  the  specific  offset.  Figure  8  indicates 
this  technique  produces  more  rapid  level  response  however 
it  has  a  detrimental  affect  on  the  product  concen t ra t  ion 
profile.  This  indicates  that  the  feedback  control  used  in 
the  product  concentration  loop  is  inadequate  during  large 
level  upsets.  An  alternative  is  to  drive  the  levels  as 
well  as  the  product  concentration  as  was  done  in  Chapter 
Four.  An  integral  criterion  which  includes  the  levels  is 
another  alternative. 

6.4  Selecting  a  Nominal  State  for  Linearization 

Since  the  point  of  linearization  is  arbitrary,  the 
question  arises  as  to  which  state  provides  the  "best" 
linear  model  for  derivation  of  the  optimal  control  policy. 

Two  obvious  choices  are  the  initial  steady  state  and  the 
final  (desired)  steady  state.  If  the  initial  steady  state 
represents  the  normal  plant  operating  state  then  it  is  an 
obvious  choice.  This  is  particularly  true  if  the  changes  are 
never  going  to  exceed  the  range  in  which  the  model  lineariza- 
t ion  is  valid  and  if  the  model  is  used  for  other  purposes 
such  as  state  estimation  and/or  mu  1 1  i  va r  iab 1 e  regulatory 


LEVEL  IN  IN  H20  CONCN  IN  PC  GLYCOL 


216 


0  15  30  45  60  75 

TIME  IN  MINUTES 

FIGURE  8a:  Response  of  Concent ra t ion  and  Liquid  Levels 
with  Fast  L  iquid  Level  Recovery  t  >  t^ 

-  experimental.  Model  5LF 
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FIGURE  8b:  Response  of  Flow  Rates  and  lemperatuie  with 
Fast  Liquid  Level  Recovery  t  )  t^ 

-  experimental.  Model  5LF 
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control.  If  the  desired  state  is  to  be  used  then  two  points 
must  be  considered.  First  this  makes  the  model  a  function 
of  the  desired  state  and  it  will  have  to  be  recalculated  for 
each  process  change.  Secondly  a  cons i s  ten t  estimate  of  all 
the  variables  in  the  model  (i.e.  all  state  and  control 
variables)  must  be  available  and  this  state  must  be  a 
realizable,  "equilibrium-point"  of  the  process.  (In  theory 
a  "controllable"  model  can  be  driven  to  the  desired  state 
even  though  the  specified  state  is  not  an  equilibrium  point). 
Use  of  the  des i red  steady  state  does  permit  the  problem  to 
be  stated  in  the  usual  textbook  form  of  driving  an  unforced 
system,  with  non-zero  initial  conditions,  to  the  origin. 
However,  since  there  is  seldom  any  means  of  picking  the  best 
state  to  linearize  about,  a  priori,  it  is  usually  more  con¬ 
venient  to  use  the  initial  state.  If  more  accuracy  is  re¬ 
quired  then  fitting  the  linearized  model  to  the  process 
response  over  the  region  of  anticipated  changes  is  probably 
best . 

The  effect  of  linearization  of  the  theoretical  nonlinear 
model  about  the  initial  versus  the  final  operating  condition 
is  shown  in  Figure  9  for  a  change  of  two  percent  by  weight 
in  the.  setpoint  of  the  product  concentration.  OS/36O  CSMP 
[18]  was  used  for  the  simulation  of  control  policies  derived 
from  models  5L  and  5LD  linearized  about  the  initial  and  final 
states  respectively.  The  object  is  to  drive  the  product  con¬ 
centration  to  the  desired  setpoint  in  minimum  time  while 
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FIGURE  9 a:  Concentration  and  Liquid  Level  Response  of 
Mode)  5NL  to  Control  Policies  Derived  from 
Model  5L  ( - )  and  Model  5LD  ( - ) 
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TIME  IN  MINUTES 

FIGURE  9b:  Flow  Rates  and  Temperature  Response  of  Model 
5NL  to  Control  Policies  Derived  from  Model 
5L  ( - )  and  Model  5LD  ( - ) 
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the  holdups  are  constrained  to  be  within  +_  5.0  lb  of  the 
nominal  process  holdups.  The  first  effect  temperature  is 
not  to  exceed  240°F .  This  constraint  is  necessary  because 
a  safety  valve  in  the  first  effect  vapor  space  of  the 
unit  releases  for  a  pressure  in  excess  of  approximately 
ten  pounds  per  square  inch. 

The  responses  in  Figure  9  indicate  that  1  i  nea r  i  za t  ion 
about  the  initial  condition  predicts  a  lower  concen t rat  ion 
to  steam  gain  than  actually  occurs  over  the  transient 
since  some  overshoot  is  evident.  Linearization  about  the 
final  steady  state  has  the  opposite  effect.  This  phenomenon 
is  due  to  the  nonlinear  gain  between  concentration  and 
steam  which  results  when  water  is  evaporated  from  a  dilute 
versus  a  more  concentrated  solution.  An  intermediate  steady 
state  would  seem  to  compromise  the  two  responses.  This 
effect  was  also  noted  in  a  previous  study  which  compared  the 
linear  evaporator  model  responses  to  load  disturbances 
with  the  actual  process  response  [19]* 

6 . 5  Evaluation  of  SAE  Criterion 

There  is  a  conspicuous  "wrong  way"  response  in  the 
product  concentration  profiles  assoc iated  w i th  the  time 
optimal  control  policies  of  Figures  7  and  8.  This  anomaly 
results  from  the  opposing  effects  of  increased  steam  versus 
increased  inter-effect  bottoms  flow.  The  use  of  an  integral 
criterion  removes  this  anomaly.  The  sum  of  the  absolute 
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errors,  SAE,  criterion  was  utilized  since  it  is  a  popular, 

1  inear  criterion.  The  holdups  and  the  first  effect  tempera¬ 
ture  (pressure)  were  constrained.  However  in  order  to 
avoid  large  level  upsets  (Figure  8),  the  levels  and  the 
product  concentrations  were  weighted,  the  product  concentra¬ 
tion  is  most  heavily. 

The  response  with  this  criteria  is  represented  graphically 
in  Figure  10.  The  profiles  in  Figure  7  can  be  compared 
directly.  The  time  optimal  response  is  more  rapid.  However, 
the  wrong  way  response  has  been  removed  in  Figure  10.  The 
actual  process  concentration  profile  (solid)  again  lagged 
that  of  the  linear  model  (dashed)  significantly.  As  ex¬ 
pected  the  control  action  and  the  process  response  to  the 
setpoint  change  is  much  less  erratic. 

The  dotted  line  in  Figure  6  is  the  experimental  single 
loop  time  optimal  response  for  a  cor  respond ing  setpoint 
change.  Again  increase  rate  of  response  is  evident  in  the 
multivariable  case  when  Figures  6  and  10  are  compared. 

The  SAE  criteria  produces  a  more  acceptable  process  re¬ 
sponse  than  the  time  optimal.  Further  experimental  runs 
with  this  criterion  will  be  presented  in  the  evaluation  of 
the  proposed  scheme  for  addition  of  this  policy  to  a 
conventional  regulatory  control  system. 
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TIME  IN  MINUTES 

FIGURE  10a:  Concentration  and  Liquid  Level  Response  to 
Control  Based  on  Model  5LF ,  SAE  Criteria 
-  model  5LF ,  -  experimental 
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F  IGUPxE  10b:  Flow  Rate  and  Temperature  Response  to  Control 
Based  on  Model  5LF 
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6.6  Comparison  of  Open  Versus  Closed  Loop  Implementation 

6.6.1  Single  Variable  Implementation 

Using  equation  (13)  as  a  control  model,  analytical  time 
optimal  switch  times  were  calculated  using  a  golden  search 
technique  as  discussed  in  Chapter  Four.  Concentration  con¬ 
trol  was  maintained  by  the  conventional  cascade  control  loop 
shown  in  Figure  5-  Discrete  values  of  the  optimal  concentra¬ 
tion  profile,  Cg*(t)  (predicted  using  equation  (13)  as 
the  process  model),  are  put  directly  into  the  setpoint  of 
the  concentration  control  loop.  The  output  from  the  con¬ 
centration  controller  is  sent  directly  to  the  setpoint  of 
the  steam  control  loop.  Fortunately  the  standard  DDC  al¬ 
gorithm  contains  provision  for  adding  a  bias  term  so  that 
the  optimal  control  action,  S*(t),  could  be  added  to  the 
output  of  the  steam  controller  as  illustrated  in  Figure  4. 
Details  of  the  control  programs  for  imp  1 ementat  ion  of  this 
scheme  are  documented  elsewhere  [17]. 

At  the  final  time,  the  optimal  trajectory,  C2*(t), 
approaches  the  desired  setpoint  and  thus  normal  regulatory 
control  is  automatically  resumed. 

Considering  feedback  compensation  for  modelling  in¬ 
accuracies,  Figures  11  and  12  show  simulated  OS/36O  CSMP , 
and  experimental  results  respectively  of  programmed  state 
driving  based  on  a  "poor"  empirical  second  order  model,  model 
1,  Table  1.  The  solid  curves  are  open  loop  programmed  control 
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TIME  IN  MINUTES 

FIGURE  11:  Simulated  Response  to  Control  Based  on  Second 

Order  Model  1  ,  , 

- open-loop,  —closed-loop,  ...  control  model 
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TIME  IN  MINUTES 

Experimental  Response  to  Control  Based  on 
Second  Order  Model  1 

-  open-loop,  -  closed-loop,  ...  control  model 


FIGURE  12: 
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trajectories  while  the  dashed  lines  represent  the  trajector¬ 
ies  generated  using  the  same  control  policy  that  produced 
the  solid  curves  but  implemented  in  a  closed-loop  configura¬ 
tion  analogous  to  Figure  4.  The  dotted  curve  is  the 
control  model  or  optimal  trajectory.  Level  loops  were  placed 
on  tight  control  and  proportional  control  was  used  in  the 
product  concentration  feedback  loop.  In  Figures  11  and  12 
the  control  model  "lags"  the  process.  Figure  13  shows  the 
simulated  results  of  a  setpoint  response  for  a  case  in 
which  the  control  model,  model  2,  Table  1,  leads  the  process. 
This  is  the  normal  case  with  theoretical  models. 

Another  cause  for  poor  response  during  setpoint  changes 
under  optimal  control  is  disturbances  which  have  not  been 
accounted  for  in  the  control  policy.  The  most  severe  load 
disturbance  encountered  by  a  control  system  for  this  pilot 
plant  evaporator  is  a  feed  disturbance.  Figure  1 4  and 
Figures  15  and  16  show  the  response  of  programmed  control 
based  on  models  2  and  3  respectively.  The  solid  lines  in¬ 
dicate  the  trajectories  followed  under  open  loop  programmed 
control  with  the  indicated  simultaneous  feed  disturbance. 

The  dotted  line  is  the  response  of  the  control  model. 

The  dashed  line  is  the  trajectory  obtained  with  the  combined 
control  scheme  of  Figure  4.  Improvement  is  evident  for 
both  simulated  (Figure  14)  and  experimental  (Figures  15  and 
16)  results.  In  both  cases  the  feed  disturbance  was  such  as 
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TIME  IN  MINUTES 

FIGURE  13:  Simulated  Response  to  Control  Based  on  Second 
Order  Model  2 

-  open-loop,  -  closed-loop,  ...  control  model 
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TIME  IN  MINUTES 

FIGURE  14:  Simulated  Response  to  Control  Based  on 
Model  2  with  (-20$)  Feed  Disturbance 

-  open-loop,  -  closed-loop, 

...  control  model 
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FIGURE  15:  Experimental  Response  to  Control  Based  on 
Model  3  with  (-10$)  Feed  Disturbance 

-  open-loop*  -  closed-loop* 

...  control  model 
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F  IGURE  16: 
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Experimental  Response  to  Control  based  on 
Model  3  with  (+25^)  Feed  Disturbance 
_ open-loop,  -  closed-loop,  ...  control 

mode  1 
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to  hasten  the  process  response  thus  caus ing  overshoot. 

Figure  17  depicts  the  simulated  results  of  a  suboptimal 
setpoint  change  based  on  model  2  with  a  simultaneous  feed 
disturbance  which  impedes  the  process  response.  Once 
again,  since  the  time  for  which  the  steam  is  at  its  lower 
constraint  is  so  small,  the  improvement  attained  with  the 
feedback  i s  sma 1 1 . 

6.6.2  Multivariable  Implementation 

Using  the  SAE  criterion,  an  open-loop  policy  was  de¬ 
rived  from  the  linear  programming  algorithm.  Figure  18 
shows  the  results  of  closed  loop  implementation  as  defined 
by  Figure  4.  The  concent ra t ion  control  was  achieved  in  the 
same  manner  as  for  the  single  loop  implementation  except 
C2*(t)  was  predicted  by  model  5LF  .  As  well  optimal  level 
profiles  (predicted  by  the  fifth  order  model)  were  put 
directly  into  the  setpoints  of  the  level  loops.  The  output 
from  these  loops  went  directly  to  the  setpoint  of  the 
bottoms  flow  control  loops  where  the  open  loop  control  action 
was  introduced  into  the  bias  in  an  analogous  fashion  to  the 
concent  rat  ion  control  scheme.  Proportional  control  was 
used  for  all  three  control  loops. 

The  dotted  line  on  the  C 2  plot  is  the  model  response, 
this  is  the  optimal  trajectory,  C2*(t).  The  dashed  line  is 
the  closed-loop  implementation.  No  output  limit  was  imposed 
on  the  steam,  therefore,  since  the  process  response  lagged 
the  model  response,  feedback  action  increased  steam  and  this 
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FIGURE  17:  Simulated  Response  to  Control  Based  on 
Model  2  with  (+10^)  Feed  Disturbance 

-  open-loop,  -  closed  loop; 


•  •  • 


control  model 


TEMPERATURE  IN  DEG  F 


LEVEL  IN  IN  H20  CONCN  IN  PC  GLYCOL 


235 


TIME  IN  MINUTES 

FIGURE  l8a:  Experimental  Response  to  Control  Based  on 
Model  5LF ,  SAE  Criterion 

-  open-loop,  -  closed-loop,  -  closed- 

loop  (output  limit),  ...  control  model 
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FIGURE  1 8b :  Experimental  Response  to  Control  Based  on 
Model  5LF ,  SAE  Criterion 
-  open  — loop  imp  1 emen tat  ion 


237 


caused  violations  of  the  pressure  constraint.  The  profile 
does  however  demonstrate  that  the  feedback  action  does 
compensate  for  modelling  errors  by  following  the  optimal 
trajectory  closely.  The  solid  curve  is  an  analogous 
implementation  except  that  the  output  of  the  steam  loop  is 
limited  to  a  value  which  maintains  an  acceptable  pressure 
in  the  first  effect  vapor  space.  Improvement  over  the 
cor  respond ing  open-loop  implementation,  the  solid  curve  in 
Figure  10,  is  evident.  This  open-loop  response  of  product 
concentration  has  been  retraced  on  Figure  18  as  the 
dashed-dotted  curve  for  convenience  of  comparison. 

Figure  19  is  an  analogous  experimental  response  for  a 
setpoint  change  in  the  opposite  direction.  Notice  that  the 
closed  loop  implementation  (dashed  line)  resulted  in  over¬ 
shoot  of  the  product  concentration.  This  resulted  from  the 
interaction  of  the  first  effect  bottoms  and  the  product 
concent  rat  ion .  The  first  effect  level  is  difficult  to  pre¬ 
dict  in  this  instance.  The  actual  level  was  higher  than 
predicted  causing  feedback  compensation  which  increased  the 
first  effect  bottoms  flow.  It  is  evident  that  a  mu  1 1 i va r i ab 1 e 
feedback  system  would  perform  much  better  than  the  multi¬ 
loop  system  of  Figure  5  in  this  case  since  interact  ions  would 
be  compensated  for  more  rapidly.  The  open  loop  response 
is  represented  by  the  solid  line.  Again  the  dotted  plot 
depicts  the  optimal  trajectory  (i.e.  the  control  model  re¬ 
sponse).  A  lower  limit  was  placed  on  the  first  effect 
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FIGURE  19a*  Experimental  Response  to  Control  Based  on 
Model  5LF ,  SAE  Criterion 

-  open-loop,  -  closed-loop, 

.  .  .  cont  rol  model 
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FIGURE  19b:  Experimental  Response  to  Control  Based  on 
Model  5LF ,  SAE  Criterion 
-  open-loop  implementation 
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temperature  (pressure)  so  that  a  vacuum  was  not  created  in 
the  first  effect  vapor  space.  This  explains  the  spike  in 
the  steam  trajectory  (sol  id  curve)  for  the  open  loop 
imp lementat ion ,  see  Figure  19b. 

7.  CONCLUS  IONS 

1.  Optimal  state  driving  techniques  under  manual  or 
computer  control  produced  improved  responses 
over  conventional  setpoint  regulatory  control  on 
a  pilot  plant  evaporator. 

2.  The  linear  programming  formulation  is  flexible 
and  permits  constraints  on  both  control  and  state 
vectors.  The  process  engineer  is,  therefore, 
able  to  tailor  the  response  to  his  desired 

spec  i  f  i  cat  ions . 

3.  Different  criteria  result  in  dramatically  different 
process  transient  responses., 

4.  Fitted  models  in  general  perform  better  than 
theoretical  models.  The  point  of  1  i  nea r  i  za t  ion 
of  the  model  affects  the  control  policy  but  the 
initial  conditions  are  the  most  convenient  steady 
state  conditions  for  1  i  nea r  i  zat  ion .  Model 
accuracy  is  important  in  optimal  control  imple- 
menta t  ion . 


2b) 


5.  The  interface  of  programmed  setpoint  control 
to  a  conventional  control  scheme  presented  in 
this  work  is  convenient  computationally  as 
well  as  in  implementation.  This  suboptimal 
control  scheme  at  least  partially  compensated 
for  modelling  errors  and  load  disturbances. 

6.  Multivariable  process  models  proved  to  be 
superior  to  low  order  models  since  they 
accounted  for  interactions  and  permitted  con¬ 
straints  to  be  specified  on  additional 

var  iables . 

7.  Many  practical  problems  in  data  reduction  and 
processing,  optimization  and  implementation 
arise  during  the  synthesis  of  optimal  control 
policies  for  real  processes. 
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CHAPTER  S  IX 


AN  INTUITIVE  APPROACH  TO  THE  SUB-OPTIMAL 
CONTROL  OF  NONLINEAR  SYSTEMS 


ABSTRACT 

Computation  of  sub-optimal  controls  of  nonlinear 
systems  using  a  parameter  estimation  algorithm  in  which 
the  parameters  in  an  assumed  functional  rep  resen ta t  ion  of 
the  control  variables  are  calculated,  is  performed  using 
only  the  state  equations.  The  method  is  more  intuitive 
than  rigorous  optimization  methods.  Separation  of 
the  control  policy  from  the  control  model  allows  considera 
t  ion  of  higher  order  dynamics  and  state  constraints  which 
are  often  neglected  in  reduced  control  models.  Simulated 
results  from  a  fifth  order  nonlinear  evaporator  model  are 
used  to  emphasize  the  advantages  and  demonstrate  the 
app  roach  . 
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1  .  I NTRO DUCT  ION 

In  certain  situations  a  linearized  model  does  not  ade¬ 
quately  represent  the  process  dynamics  of  a  nonlinear  system. 
Either  a  series  of  linear  models  or  a  rigorous  nonlinear 
model  is  required  to  describe  the  process  dynamics.  Imple¬ 
mentation  of  control  policies  derived  from  a  "chain"  of 
linear  models  is  difficult  due  to  the  problem  of  matching 
states. 

This  chapter  describes  a  sub-optimal  method  of  synthesiz¬ 
ing  a  control  policy  based  on  a  nonlinear  model.  The  tech¬ 
nique  involves  specification  of  the  functional  form  of  the 
control  policy.  The  unknown  parameters  in  this  function  are 
then  calculated  so  as  to  optimize  a  performance  index  which 
is  a  function  of  the  model  trajectory. 

The  control  policy  may  be  constructed  in  such  a  manner 
as  to  trade  off  control  complexity  versus  marginal  improve¬ 
ments  in  minimization  of  the  index  of  performance.  In  many 
cases  the  form  of  the  optimal  control  law  can  be  predicted 
from  Pontryagin's  Maximum  Principle.  Time  optimal  control 
laws  often  fall  into  this  category.  When  the  functional 
form  of  the  optimal  control  policy  is  known, the  result  of  the  al¬ 
gorithm  presented  in  this  work  will  be  optimal,  except  for 
errors  in  numerical  solution. 

Separation  of  the  control  policy  from  the  model  order  is 
desirable  in  many  instances  due  to  state  constraints  and 
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higher  order  dynamics  which  cannot  be  incorporated  into  re¬ 
duced  models  but  can  be  considered  with  the  rigorous  model. 
For  example  recall  that  the  reduced  second  order  models  of 
Chapter  Four  did  not  include  the  state  constraints  and 
therefore  the  control  law  was  simpler  in  its  form.  Re¬ 
sults  presented  in  Chapter  Five  indicate  that  model  accuracy 
is  important  for  open-loop  implementation  of  optimal  control 
policies.  The  sub-optimal  control  approach  presented  in 
subsequent  sections  is  intuitive  and  is  readily  "tuned"  to 
the  actual  process.  The  computational  algorithm  employed 
to  determine  the  suboptimal  control  policy  was  developed 
for  parameter  estimation  as  described  in  Chapter  Three.  The 
algorithm  employs  quas i 1 i nea r izat ion  in  conjunction  with 
linear  programming. 

Computation  of  the  sub-optimal  control  policy  for  a 
model  of  a  pilot  plant  evaporator,  which  is  composed  of 
five  nonlinear  differential  equations,  is  used  to  demonstrate 
the  app roach  . 

2.  DEVELOPMENT 

Many  nonlinear  dynamic  systems  can  be  conveniently  re¬ 
presented  by  the  following  vector  differential  equation: 

x(t)  = 


l(x(t) ,  u(t)) 


(1) 
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with  the  initial  conditions  vector: 


x(tD)  =  *o  (2) 

The  optima]  control  problem  is  to  determine  the  control, 
_u(t),  which  will  minimize  the  following  objective  function 
and  remain  within  the  bounds  a  <  jj(t)  ^  |3: 


J  =  ^  L  [x(t)  ,  _u(t)]  dt 


Constraints  on  elements  of  the  state  vector  are  also  common. 
Two  approaches  to  the  solution  of  this  problem  have  received 
the  most  attention,  dynamic  programming  and  Pontryagin's 
Maximum  Principle  [1].  The  curse  of  dimensionality  prevents 
the  use  of  dynamic  programming  for  many  practical  problems. 
The  latter  approach  leads  to  the  classical  nonlinear  two 
point  boundary  value  problem  which  requ ? res  solution  by 
direct  iteration,  search  techniques,  quas  i  1  inear  i  zat  ion  or 
invariant  imbedding.  However,  state  and  control  variable 
constraints  are  introduced  only  with  great  difficulty.  The 
use  of  penalty  functions  for  the  i nco rpo rat  ion  of  state 
constraints  is  popular  [2].  Also  the  numerical  integration 
of  the  costate  equations  which  arise  from  Pontryagin's 


' 
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Maximum  Principle  are  inherently  unstable  and  often  are  a 
stumbling  block  in  the  way  of  a  practical  solution  [2]. 

The  approach  adopted  in  this  work  is  to  calculate  a 
"sub-optimal"  control  law  in  such  a  way  as  to  avoid  the 
costate  equations  while  allowing  easy  incorporation  of  state 
and/or  control  constraints  into  the  problem.  The  optimal 
control  problem  is  converted  into  a  parameter  estimation 
problem  in  the  following  manner.  It  is  assumed  that  _u(t) 
can  be  represented  by: 


(*) 


U  J  ( t)  =  0|(a.,t)  for  i  =  1,  2, 


.  .  . ,  m 


where  the  vectors  _a.  are  vectors  of  unknown  parameters  in 
the  functions  0j.  These  parameters  could  be  coefficients 
in  a  polynomial  in  t,  switching  times  or  arguments  of  tran¬ 
scendental  functions.  The  sub-optimal  control  problem  then 
becomes  one  of  determining  the  unknown  parameters  in  the 
functions  0j  such  that  the  objective  function,  J 1 ,  is 
minimized  where  is  of  the  form: 


J 


(5) 


t 


o 


o  r 


in  the  discrete  form  which  is  more  convenient  for 


digital  computer  solution: 
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N 

J,  -  £  S(x(tk),  xd)  (6) 

K  —  i 

The  algorithm  employed  restricts  the  objective  function 
represented  by  equation  (6)  to  a  linear  or  quadratic 
cr  i ter  ion  such  as: 

.  SAE:  J,  -  r  aT(tk)  I  x(tk)  -  xd  I  (7) 

k  1 

N  T 

Least  Squares:  J,=  2  (x(  -  xd)  Q(  tR)  (x(  tR.)  -xd)  (8) 

k- 1 

Time  Optimal:  =  X  where  X  >  |x;(tk)  -  x  .|  (9) 

for  i  =  1?  2,  n,  where  Jj 

must  be  minimized  for  each  trial  of  N. 

Other  criteria  such  as  minimum  rise  time  subject  to  a 
specified  settle  out  time  are  also  possible. 

The  specific  algorithm  used  in  this  work  requires  an 
initial  guess  for  the  unknown  parameter  values.  Quasilinear¬ 
ization  is  then  used  to  create  a  linear  boundary  value  problem 
which  is  solved  by  Runge  Kutta  integration.  The  ensuing 
linear  estimation  'which  must  be  solved  to  obtain  new  values 
for  the  parameters  is  performed  by  linear  programming  methods. 
Details  of  the  algorithm  were  presented  in  Chapter  Three. 
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Davison  and  Monro  [3]  using  Rosenbrock's  h  i  1 1 c 1  imb  i  ng 
method  with  numerical  integration  procedures  treat  the  time 
optimal  control  problem  in  an  analogous  fashion  to  this 
work.  They  present  several  mu  1 1 i var iab  le  numerical  examples 
which  however  have  scalar  control  vectors.  Pollard  and 
Sargent  [4]  employ  the  F 1 etcher-Powe 1 1  conjugate  direction 
method  to  calculate  time-optimal  switch  times  for  a  nonlinear 
model  of  a  binary  distillation  column.  Baily  [5], 

O'Kelly  [6]  and  deRooy  [7]  describe  the  techniques  which 
involve  assuming  the  functional  form  of  the  control  law 
for  determining  sub-optimal  control  policies  for  linear 
multidimensional  systems. 

3 •  COMPUTAT  iONAL  ASPECTS 

During  the  application  of  the  parameter  estimation  scheme 
to  numerical  examples  several  computational  difficulties  were 
encountered.  In  general  the  technique  is  restricted  to  a 
small  number  of  parameters  which  hampers  its  usefulness  with 
multivariable  systems.  The  solutions  are  usually  very 
sensitive  to  the  state  variable  weighting  chosen  for  the 
p  rob  1 em . 

When  calculating  bang-bang  type  control  policies  in¬ 
volving  unknown  switching  times,  state  variable  trajectories 
are  very  sensitive  to  changes  in  these  switching  times. 

Because  linearization  is  employed  in  this  approach  the  magni¬ 
tude  of  the  changes  must  be  restricted.  The  constrained 
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parameter  convergence  technique  introduced  in  Chapter  Three 
is  very  useful  in  this  context.  However,  unless  the  initial 
guesses  for  the  parameters  are  very  close  to  the  optimal 
values,  the  algorithm  results  in  large  computation  times  in 
order  that  numerical  stability  be  ensured. 

A  very  desirable  feature,  which  was  not  implemented  in 
this  work,  is  the  adjustment  of  the  integration  interval 
to  exactly  coincide  with  the  current  switching  times. 

If  the  number  of  switch  times  chosen  to  characterize 
the  particular  bang-bang  control  law  is  too  large,  small 
switch  intervals  are  obtained  [3]  and  they  can  be  eliminated. 
By  iteration,  the  user  can  determine  the  best  specification 
of  the  number  of  switching  times  for  each  variable. 


4.  A  NON-LINEAR  NUMERICAL  EXAMPLE 


Consider  the  nonlinear  system: 


x 


x 


L  2J 


0 


l-2x^  0 


- 

“  “ 

■*  ** 

X1 

0 

+ 

1 

L  2  J 

u(t)  (10) 


where  |u(t)|  ^  1.  The  control  variable,  u(t),is  manipulated  in 
a  bang-bang  control  fashion  with  three  switch  intervals  and  the 
criterion  is  minimum  time.  Table  1  compares  the  results 
obtained  by  Davison  and  Monro  [3]  with  those  obtained  in  this 
work.  Computational  time  was  approximately  10  seconds  on  an 


IBM  360/67  digital  computer. 
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This  Work 


Dav  i  son  and 
Monro  [3] 


TABLE  1 

TIME  OPTIMAL  SWITCH  TIMES 

Sw  itch  T  T me 

T1  T2  T3 

0.25  2 . 5^  3.06 

0.26  2.52  3.06 


Initial  State 

X1  X2 

1.0  1.0 


1.0  1.0 
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5-  APPLICATION  TO  A  DOUBLE  EFFECT  EVAPORATOR 

The  parameter  estimation  algorithm  was  successfully 
applied  to  the  characterization  of  several  assumed  control 
laws.  The  criterion  employed  wa s  that  of  minimizing  the 
rise  time  subject  to  specified  limits  on  the  overshoot. 

5 . 1  Description  of  Process 

The  pilot  plant  process  is  described  in  Appendix  A  and 
the  fifth  order  nonlinear  model  is  summarized  in  Appendix  B. 
The  variable  of  prime  interest  is  the  product  concentration 
which  is  controlled  by  manipulation  of  the  steam  flow  rate. 
Two  other  cont ro  1  va r  iab les  of  interest  are  the  liquid 
levels  of  the  two  effects.  In  this  treatment  the  object  will 
be  to  obtain  rapid  product  concent  rat  ion  response  without 
violating  the  upper  limit  on  the  pressure  (temperature)  in 
the  first  effect  vapour  space. 

5  •  2  Conventional  Control  Law 

Attempts  to  optimize  the  proportional  and  integral 
controller  constants  of  the  steam  to  product  concentration 
loop  for  set-point  changes  on  a  fifth  order  linear  analog 
computer  model  were  fruitless.  The  constants  could  be  in¬ 
creased  to  values  which  were  far  too  high  for 
stability.  The  nonlinear  five  equation  model  described 
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in  Appendix  B  was  therefore  used  along  with  the  parameter 
estimation  routine  which  optimized  the  controller  constants 
The  dotted  curve  in  Figure  1  depicts  the  optimal  trajectory 
obtained  (K  =  0.5^3>  K|  =  1.51) •  The  control  law  is  of 
the  form: 


u(t)  -  Kp  (c2  -  c2d)  +  Ki  (*6>  (ii) 

where  x^  is  a  variable  which  is  appended  to  the  state 
vector.  The  following  differential  equation  is  added  to 
the  vector  differential  equation  (1): 


'6 


(Co  -  C2d) 


(12) 


Thus  the  system  is  represented  by: 


1  (z,  Kp.  K,) 


(13) 


The  object  of  the  parameter  estimation  is  to  chose  and 
K|  such  that  some  function  of  the  difference  between  the 
model,  equation  (13)  and  the  desired  product  concentration 
profile  is  minimized.  In  this  example,  a  step  was  chosen 
as  the  desired  response. 
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Response  of  Model  5N L  to  Subopt  imal  Control 
St rateg  ies 


F  IGURE  1: 


25^ 


5 •  3  Sub-Optimal  Control 

In  Chapter  Four  it  was  noted  that  a  second  order  transfer 
function  model  did  not  account  for  interact  ions ,  constraints 
or  higher  order  dynamics.  By  separating  the  control  strategy 
from  the  order  of  the  model  these  "higher"  order  cha racter  i  s t  i  cs 
may  be  retained.  For  a  positive  change  in  product  concentra¬ 
tion  a  control  strategy  like  the  one  represented  schematically 
in  Figure  2  was  chosen  for  the  steam  rate.  The  shaded  area 
in  F  igure  2  represents  the  added  control  action  gained  over 
the  bang-bang  control  law  derived  from  a  second  order  model. 

The  second  order  approach  required  specification  of  maximum 
and  minimum  steam  rates.  These  values  had  to  be  chosen  by 
trial  and  error  so  as  to  conform  to  state  constraints. 

The  unknown  parameters  of  the  control  law  were  chosen 
to  be  the  three  switch  times,  t^,  t^  and  t^>  as  well  as  the 
magnitudes  of  the  intermediate  steps,  A-j  and  l\  .  The 
maximum  and  minimum  steam  rates  are,  of  course,  known. 

These  constants  were  chosen  so  as  to  minimize  the  product 
concentration  rise  time  subject  to  the  constraint  of  the 
first  effect  pressure  and  to  limits  on  the  overshoot  and 
undershoot  of  the  product  concentration. 

The  simulated  result  is  shown  as  the  solid  line  in 
Figure  1.  Note  the  improved  response  over  conventional  con¬ 
trol  tuned  for  servomechanism  control  app 1  i  cat  ions  .  The 
control  policy  could  easily  be  experimentally  "tuned"  to  the 
actual  process  in  the  same  manner  that  the  control  policy 
of  the  second  order  models  were  tuned  in  Chapter  Four. 
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FIGURE  2:  Assumed  Control  Law  for  Steam 
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5 .4  S  ta  rt  up 

During  startup  of  the  evaporator  the  product  refracto- 
meter  reading  is  unreliable  and  the  vacuum  in  the  second 
effect  is  not  constant;  therefore,  if  startup  is  to  be 
optimized,  it  must  be  done  in  an  open-loop  fashion  based  on  a 
process  model . 

The  problem  considered  in  this  section  was  to  drive 
the  evaporator  from  a  condition  in  which  only  levels  had 
been  established  to  the  desired  operating  condition.  The 
object  was  to  minimize  the  rise  time  of  the  product  concen¬ 
tration.  Again  the  first  effect  pressure  limit  must  be 
imposed.  The  process  model  had  to  be  modified  over  the  ini¬ 
tial  trajectory  to  include  the  second  effect  energy  balance 
until  operating  temperature  was  obtained  at  which  time  the 
model  reverted  to  model  5NL.  The  control  vector  includes 
the  steam  flow  rate  and  the  feed  rate. 

A  control  law  for  steam  similar  to  that  of  Figure  2 
was  assumed  (except  S  =  0  until  time  t  ) .  The  control  law 
for  the  feed  flow  rate  was  assumed  to  be: 

F  =  1 .0  +  3-5  ( 1  "  exp  ( -Xt) ) 

It  remained  to  deteimine-  A  -J  ,  A^ ,  t  •[ ,  t  ^  j  t^  and  \ . 


(14) 


. 
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Many  runs  with  vary  ing  initial  estimates  of  control 
parameters  failed  to  produce  a  converged  solution.  Changes 
in  steam  switching  times  and  \  were  too  severe  for  the 
linearizations  involved  in  the  quas  1 1  inear  izat  ion  algorithm. 

6.  CQNCLUS  IONS 

(  1 )  Spec  i  f icat  ion  of  the  control  law  in  a  functional 
form  with  unknown  parameters  and  optimization  of  these 
parameters  by  a  parameter  estimation  algorithm  is  shown  to 
be  a  method  of  determining  sub-optimal  control  laws  for 
non  1  i nea r  systems . 

(2)  The  technique  gives  the  designer  more  flexibility 
than  rigorous  optimization  techniques. 

(3)  Numerical  instability  is  encountered  in  calculating 
the  optimal  switching  times  of  a  bang-bang  type  control 

law  unless  the  initial  estimates  of  these  times  are  near  to 
the  optimal  values  or  unless  a  convergence  technique  such  as 
constrained  parameter  perturbation  is  used.  Parameters  in 
smooth  functions  such  as  polynomial  expansions  would  be 
more  easily  estimated. 

(4)  When  the  form  of  the  optimal  control  law  is  known 
the  control  policy  obtained  by  this  technique  can  be  optimal. 


CHAPTER  SEVEN 


DISCUSSION  AND  CONCLUSIONS 
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1  .  GENERAL  DISCUSSION 

Quas  i  ]  inea r  izat  ion  and  linear  programming  techniques  were 
applied  to  optimal  state  driving  control  systems.  Results 
in  the  form  of  experimental  and  simulated  runs  successfully 
demonstrate  the  utility  of  the  procedures.  Sufficient 
documentat  ion  of  runs  and  computer  programs  have  been  pro¬ 
vided  so  that  this  work  could  serve  as  a  starting  point  for 
future  studies  or  industrial  implementation.  Documentat ion 
includes: 

(1)  graphical  presentation  of  runs 

(2)  tabular  summary  of  run  (simulated  and 
experimental)  conditions  and  parameters 
(Appendix  C) 

(3)  an  experimental  run  book  (bound  separately) 

(4)  documentation  of  computer  programs  and  example 
solutions  (bound  separately  from  thesis). 

In  subsequent  sections  the  utility,  future  work,  related 
problems  and  overall  conclusions  of  the  thesis  are  presented 
briefly. 

2.  INDUSTR  IAL  USE 

The  results  of  the  implementation  of  optimal  control 
strategies  on  a  pilot  plant  sized  evaporat ion  unit  indicate 
the  approach  used  in  this  work  has  practical  significance. 
Several  features  of  the  control  scheme  discussed  and  evaluated 
in  previous  chapters  are  oriented  towards  industrial  imple¬ 
mentation  and  some  are  summarized  in  the  following  sub-sections. 
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2 . 1  Generalized  Modelling  Techniques 

Utilization  of  a  generalized  parameter  estimation  algorithm 
such  as  the  one  developed  in  this  work  for  identification  of 
a  process  model  does  not  requires  thorough  knowledge  of  the 
numerical  methods  utilized.  The  user  must  simply  code  his 
particular  process  model  in  FORTRAN  and  numerically  encode  the 
experimental  data  a'nd  system  parameters  and  constraints.  In¬ 
corporation  of  a  great  deal  of  a  priori  information  into  the 
problem  solution  in  the  form  of  constraints,  weighting  factors 
and  model  features  is  possible  with  the  algorithm  presented. 

2 . 2  Convenient  Mathematical  Analysis 

Linear  programming,  a  familiar  mathematical  tool  in 
the  process  industry,  is  employed  in  the  dynamic  optimization 
of  the  open--loop  process  model  response.  Mathematical 
analysis  using  the  open-loop  model  is  less  complex  than  that 
of  the  closed-loop  model.  Several  popular  linear  criteria, 
such  as  time  optimal,  sum  of  absolute  errors  and  minimum  rise 
time,  can  be  used.  With  convenient  addition  of  constraints 
on  the  control  and/or  state  variables  the  control  engineer 
can  tailor  the  process  response. 
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2 .3  Manual  Implementations 

Open-loop  manual  implementation  of  some  simple  control 
strategies  is  practical.  Through  the  use  of  constraints 
the  control  engineer  may  "ease"  into  optimal  control  by 
limiting  magnitudes  and  rates  of  process  variable  changes. 

2 .4  Addition  to  DDC  System 

The  optimal  control  policy  based  on  the  open-loop  model 
Is  added  to  the  existing  DDC  regulatory  feedback  control 
scheme  In  such  a  manner  that  modelling  errors  and  distur¬ 
bances  are  compensated  for  by  feedback  action.  The  control 
scheme  automatically  reverts  to  the  original  DDC  regulatory 
control  scheme  when  the  new  steady  state  is  reached.  Simple 
FORTRAN  programs  accomplish  this  control  strategy  easily. 

3.  APPLICATION  TO  OTHER  PROBLEMS 

in  previous  chapters  quas  i  1  inea r  i  zat  ion  and  linear 
programming  were  applied  to  problems  arising  in  the  design 
of  a  state  driving  control  system.  However,  many  of  the 
advantages  of  these  numerical  methods  could  be  exploited  in 
other  applications. 

3 . 1  Linear  Programming 

Mathematical  programming  techniques  are  used  in  many 
and  varied  applications.  A  few  applications  relevant  to 
this  work  are  worthy  of  mention. 


. 
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3*1-1  Qu  rye_  F  _[t  t  _mc[ 

Although  linear  programming  is  not  frequently  used  in 
multiple  linear  regressions  several  advantages  accrue  when 
it  is  utilized.  The  use  of  linear  programming  for  this 
statistical  task  is  not  new  [1-3].  Clare  [4]  employed  this 
technique  to  fit  a  the rmodynam i c  equation  of  state  to 
PVT  data. 

Poor  data  can  seriously  affect  the  fit  when  the 
Chebyshev  criterion  is  used.  But,  careful  analysis  of  the 
solution  allows  location  of  gross  errors. 

Applications  closely  related  to  this  work  are  evident: 

(a)  z  transforms 

An  assumed  sampled  data  model  (equation  (1))  is  to  be 
fitted  to  a  time  series  of  experimental  data,  y(k)  and 
u(k): 


(1) 


In  equation  (1)  i  represents  a  transport  delay  of  i  sample 
times.  The  problem  is  to  estimate  parameters  (aQ,  a-j  ...  ap)  , 
(b^,  b^,  ...,  bn)  and  i.  A  one  dimensional  search  is  re¬ 
quired  to  determine  the  transport  delay.  Parameters  (aQ,  a^, 
...,  an)  and  (b^,  b^,  ...,  b^)  can  be  evaluated  by  linear 
programming.  If  equation  (1)  is  transformed  back  to  the 
time  domain,  the  following  difference  equation  is  obtained: 


' 
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n  n 

)  a .  y,  V  a  .  u,  .  . 

L  J  yk-J  L  J  k-j-i 

j=l  j=0 

(2) 

k  =  1,2,  . . . ,  N 

The  least  squares  criteria  is  commonly  used  to  estimate 
the  parameters  (Chapter  2,  Section  4).  If  the  Chebyshev 


or  the  SAE 

criterion  is  used,  the  estimation  can  be  readily 

fo’rmu  1  ated 

in  such  a  manner  that  linear  programming  can  be 

ut i 1 i zed. 

(b)  Laplace  transforms 

A  common  problem  in  control  applications  is  the  esti¬ 
mation  of  parameters  in  a  Laplace  transfer  function  model 
so  as  to  fit  experimental  frequency  response  data.  The 
model  is  the  ratio  of  two  polynomials  times  a  transport 


delay  term: 

G  (  s) 

-  e"TdS(ao  +  alS  +  •••  +  ansn)  (3) 

(1  +  bls  +  bgs2  +  ...  +  bnsn) 

Again  the  transport  delay  must  be  determined  by  a  one  dimen¬ 
sional  search.  To  fit  the  frequency  response  data  S  is  replaced 
by  j uu  and  equation  (3)  separated  into  real  and  imaginary  parts: 

G  ( j  ud)  =  Re(joi)  +  j  Im(juu)  (4) 
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Least  squares  techniques  are  often  employed  (Chapter  2, 
Section  7).  The  criteria  used  with  linear  programming  must 
be  a  linear  function  of  the  weighted  real  deviations  and  the 
weighted  imaginary  deviations. 

The  advantages  of  using  linear  programming  over  least 
squares  are  threefold: 

(1)  alleviation  of  the  inherent  ill-conditioned 
phenomenon 

(2)  convenient  addition  of  constraints  on  parameters 
to  force  a  physically  meaningful  solution 

(3)  convenient  constraints  on  model  response  to 
force,  for  example,  known  slopes  on  a  Bode  plot. 

3*1.2  Des j_gn_of_Dj_g_[ta  l__Con t  ro  l_]_e  rs 

An  analysis  similar  to  that  of  section  3-1-ia  is 
applicable  to  the  design  of  digitally  compensated  control 
systems.  In  this  instance  (a  ,  a^,  ...,  an)  and  (bj,  , 

...,  b  )  of  equations  (1)  and  (2)  are  known  process  para¬ 
meters  and  the  object  is  to  synthesize  a  digital  controller 
to  make  a  stable,  realizable  control  system.  The  digital 
controller  will  be  assumed  to  have  the  following  form: 
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[ C0  +  C1Z_1  +  •••  +  cn2~n) 

(  1  +  d ,  z  +  .  .  .  +  d  z  ) 

where  it  remains  to  determine  the  constants  (c  .  c . ,  ....  c  ) 
and  (d^,  d^,  .  ..,  d  )  .  The  ob  j  ect  ive  f  unct  ion  for  the  linear 
programming  formulation  is  the  choice  of  the  designer;  eg. 
sum  of  the  absolute  sampled  errors.  The  use  of  linear 
programming  allows  constraints  on  the  manipulated  variable 
as  well  as  the  sampled  errors  [5,6]. 

3  . 2  Quas ? 1  inear  izat  ion  and  Linear  Programming 

The  algorithm  developed  in  this  work  for  estimation  of 
parameters  in  an  assumed  process  model  (Chapter  3)  or  for 
character  iz i ng  an  input  (Chapter  6)  is  applicable  to  many 
problems  which  arise  in  a  chemical  engineering  environment. 
For  example,  the  algorithm  is  directly  applicable  to  the 
two  point  boundary  value  problem  which  arises  in  optimal 
control  theory  from  the  Pontryagin's  Maximum  Principle  [7]. 
Application  to  the  adjustment  of  dynamic  process  data  is  a 
direct  extension  to  the  approach  used  in  this  work  for  ad¬ 
justment  of  steady  state  data. 

3.2.1  A  dj_us  tment_of  _T  rans  j_ent  _P  roces  s_Data 
A  data  acquisition  and  adjustment  program  was  used  in 
this  work  to  obtain  a  consistent  estimate  of  the  stationary 
state  of  the  plant.  Linear  programming  was  utilized  in  the 
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adjustment  phase  of  the  algorithm.  The  steady  state 
material  and  energy  balance  equations  served  as  linear 
constraint  equations.  For  the  analogous  dynamic  situation 
quas  i  1  inea r  i  zat  ion  is  suitable  for  generating  linear  material 
and  energy  balance  constraint  equations. 

The  adjustment  can  be  performed  at  each  sampling 
instant  assuming  input  va r  i  ab 1 es cons tant  over  the  sampling 
interval  (TPBVP)  .  Or  the  complete  set  of  transient  data  can 
be  employed  (MPBVP)  and  coefficients  in  functional  approx ima- 
tions  to  input  variables  be  estimated.  The  latter  would 
result  in  smooth  curves  over  the  trajectory. 

Unknown  parameters  such  as  heat  transfer  coefficients 
can  be  estimated  along  with  the  state  vector.  This  proce¬ 
dure  is  for  all  practical  purposes  an  off-line  technique 
of  data  adjustment.  Kalman  filtering  techniques  [8]  are 
more  readily  adapted  to  on-line  applications  when  a  control 
computer  is  available. 

4  .  FUTURE  WORK 

Further  work  with  the  techniques  presented  in  previous 
chapters  is  required  in  the  form  of  more  varied  app  1  icat  ions , 
improvements  in  computational  efficiency  and  imp  1 ementat ion , 
and  comparisons  with  other  techniques.  The  following 
sub-sections  outline  the  suggestions  as  applied  to  the 
various  stages  of  the  optimal  state  driving  design  procedure. 
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4 . 1  Data  Adjustment 

(1)  The  object  of  the  MEBOL  program  utilized  in  this 
work  was  to  obtain  a  working  algorithm  which  provided  a 
consistent  set  of  data.  Hypothesis  testing  was  used  in  the  de¬ 
tection  of  gross  errors  and  linear  programming  in  the  data 
adjustment.  Maximum  likelihood  estimation  is  more 
attractive  from  a  statistical  viewpoint.  Also  it  has  been 
suggested  that  model  d  i  sc r  im  i  nat i on  procedures  on  the  basis 

of  likelihood  ratios  would  provide  an  alternate  method  for 
detection  of  gross  errors  [10].  The  technique  involves 
comparing  the  likelihood  ratios  of  models  (ie.  steady 
state  material  and  energy  balances)  formed  by  assigning 
the  errors  of  closure  of  the  balances  to  each  measurement 
in  turn. 

(2)  The  Kalman  filter  requires  estimates  of  the 
initial  state  of  the  plant  and  the  covariance  matrix  of  the 
state  vector.  These  can  be  readily  supplied  by  MEBOL 
providing  an  excellent  starter  for  the  filter. 

4 . 2  P  rocess  I  dent  ?  f  ? cat  ion 

(1)  Computational  streamlining  for  the  algorithm 
presented  in  Chapter  3,  was  discussed  in  section  3  of  that 
chapter.  The  integration  phase  of  the  solution  warrants 
the  greatest  amount  of  attention.  Evaluation  of  the 
stability  of  simplified  numerical  integration  methods  at 
least  in  phase  I  of  the  solution  is  suggested.  Hybrid  com- 
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putat ion  is  clearly  advantageous. 

(2)  Comparison  of  the  method  described  in  this  work 
to  other  procedures  on  the  basis  of  computational  ease, 
convergence,  flexibility  and  ease  of  utility  is  desirable 
to  fully  evaluate  the  power  of  this  approach. 

(3)  Although  the  quas  i  1  i  nea r  i  zat  ion  plus  linear 
programming  method  was  applied  to  several  real  engineering 
problems,  application  to  other  systems  would  provide  a 
more  complete  insight  into  the  advantages  of  the  approach 
used  in  this  work. 


4 .3  Dynamic  Optimization 

(1)  Performance  of  other  techniques  for  computat ion 
of  optimal  controls  should  be  compared  to  the  numerical 
methods  used  in  this  work.  Incorporation  of  constraints 

on  state  and  control  variables,  ease  of  use,  and  limitations 
should  be  considered  as  well  as  computational  time. 

(2)  Extension  of  the  linear  programming  formulation 
to  the  approximate  solution  of  continuous  linear  optimal 
control  problems  is  easily  performed  [9]. 


4 . 4  Imp  1 ementat ion 

(1)  Although  the  evaporator  used  in  this  work  involves 
unobserved  state  variables,  non  1 i nea r i t i es ,  control  and 
state  constraints  and  moderate  dimensions,  imp  1 ementat ion 
of  optimal  control  policies  on  other  processes  (such  as  the 
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distillation  column  in  the  Department  of  Chemical  and 
Petroleum  Engineering  at  the  University  of  Alberta)  would 
fuither  demonstrate  the  practicality  of  the  approach. 

(2)  The  concept  of  using  a  series  of  optimal  control 
policies  based  on  linear  process  models  is  promising.  The 
piocess  is  dt  iven  to  a  pre-arranged  state  whereupon  a  new 
model  comes  into  effect.  However  the  process  may  or  may  not 
attain  this  desired  condition.  The  feedback  implementation 
introduced  in  Chapter  Six  would  be  useful  in  this  context. 

An  alternative  is  the  use  of  a  nonlinear  model. 

(3)  On-line  tuning  of  switching  parameters  has  obvious 
advantages.  This  may  be  possible  only  for  elementary  control 
laws  such  as  the  time  opt  ima 1 ■ control  policy  based  on  a 
single  input  system  described  by  a  second  order  differential 
equat  i on . 

(4)  Control  programs  used  in  this  work  were  process 
programs  however  they  were  not  incorporated  into  the  DDC 
monitor  system.  Development  of  imp  1 emen tat  ion  routines  as 
an  integral  part  of  the  monitor  system  would  result  in  more 
efficient  and  convenient  utility. 

5.  CONCLUS  IONS 

Specific  conclusions  are  included  in  each  chapter:  however 
several  overall  points  are  evident: 
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(1)  An  adjustment  program,  MEBOL,  was  developed  and 
used  routinely  as  part  of  the  evaporator  run  procedure  since 
it  provided  a  consistent  set  of  data  for  use  in  subsequent 
optimization  or  engineering  calculations  [11]. 

(2)  Quas  i  1  inear  izat  ion  and  linear  programming  combine 

to  make  a  general  and  effective  parameter  estimation  algorithm. 

(3)  The  accuracy  of  a  process  model  is  much  more 
critical  in  state  driving  control  than  in  regulatory  appli¬ 
cations.  The  adequacy  of  the  model  must  be  judged  by  its 
performance  in  actual  applications  and  not  by  a  measure  such 
as  the  "goodness-of-f i t"  based  on  a  comparison  of  the  open- 
loop  model  responses  with  experimental  data. 

(4)  Fitted  models  in  general  performed  better  than 
purely  theoretical  models  in  optimal  control  implementation. 
Reduced  models  fitted  to  the  process  response  resulted  in 
simple  control  laws  which  could  be  tuned  experimentally. 
However,  the  design  procedure  for  these  reduced  models 

did  not  handle  state  constraints. 

(5)  Optimal  state  driving  techniques  produce  improved 
performance  over  conventional  three  mode  control  for  set- 
point  changes.  The  advantage  of  these  techniques  is 
particularly  evident  during  large  changes  such  as  those 
that  occur  during  startup. 
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(6)  A  control  configuration  was  developed  whereby 
the  feedback  control  loops  are  not  opened  during  setpoint 
changes  and  in  fact  are  used  to  partially  compensate  for 
model  inaccuracies  and  load  disturbances.  The  use  of  the 
open-loop  model  simplified  computation.  The  optimal  policy 
was  added  to  the  feedback  scheme  so  that  the  process  automa¬ 
tically  reverts  to  the  original  regulatory  control  scheme 
when  the  new  setpoints  are  reached. 

(7)  For  certain  criteria  the  optimal  control  problem 
for  nonlinear  systems  can  be  formulated  as  a  parameter 
estimation  problem. 

(8)  The  programs  and  procedures  have  been  tested  on 
pilot  plant  equipment  and  they  are  considered  practical  for 
industrial  use.  Optimal  control  policies  may  be  introduced 
progressively  and  may  incorporate  existing  procedures. 
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NOMENCLATURE  FOR  CHAPTER  THREE 


A 

B 

b 

_c 

C 

l 

£ 

J 

m 

n 

N 

P 

£ 

r 

s 

t 

_u 

v 

V 

w 

w 

X 

£ 


coef f  ic  lent  mat  r  ix 
bas  i  s  mat  r  ix 
right-hand-side  vector 
cost  vector  in  LP  sense 
cova r i ance  mat r ix 

vector  of  functions  in  state  variable  notation 

vector  of  functions  in  augmented  state  variable 
notat ion 

Jacob  i  an  matrix 

number  of  inputs 

number  of  state  variables 

integer  number  of  data  points/sets 

number  of  parameters 

unknown  parameters  vector 

number  of  outputs 

standard  deviation 

t  ime 

vector  of  inputs 
part  icular  solution 
var  i ance  mat  r i x 
we  ight  ing  factor 
noise  vector 
state  vector 
output  vector 
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Nomenclature  for  Chapter  Three  (continued) 


Z_ 

augmented  state  vector 

z 

objective  function 

Subscr 

ipts 

i 

state  variable  subscri 

j 

data  set  number 

k 

t  ime  po  i nt  number 

B 

bas  i  s 

DS 

data  sets 

P 

part  icu  lar 

S  upersc  r ipts 

m 

i  t erat ion  number 

G  reek 

S  ymbo 1 s 

A 

fundamental  matrix 

e  1 

pos  it  ive  dev iat ion 

e2 

negative  deviation 

uj 

dua 1  variables 

X 

maximum  deviation 

max  imum  dev i at  ion 
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NOMENCLATURE  FOR  CHAPTER  FOUR 


A 

B 

B, 

B2 

C1 

C2 

CF 

e  . 

—  i 

F 

kp 

kl 

°2 

P1 

r 

rQ 

S 

T 

b 

tf 


state  variable  coefficient  matrix 
control  variable  coefficient  matrix 
first  effect  bottoms  flow  rate  (Ib/min) 
second  effect  bottoms  flow  rate  (Ib/min) 

glycol  concentration  in  first  effect  (wt  fraction) 

glycol  concentration  in  second  effect  (wt  fraction) 

glycol  concentration  in  feed  (wt  fraction) 

t  h 

state  variable  weighting  vector  at  i  sampling 
instant 

feed  flow  rate  (Ib/min) 

process  gain,  product  concent  rat  ion  to  steam 

linear  gain,  product  concentration  to  steam 

overhead  first  effect  (Ib/min) 
overhead  second  effect  (Ib/min) 

pressure  in  first  effect  vapor  space  (psig) 
desired  setpoint  for  y 
i n  i  t  ia 1  setpo  i n t  for  y 
steam  flow  rate  (Ib/min) 
samp  ling  t  ime 

first  effect  temperature  (°F) 
temperature  of  the  feed  (°F) 
switching  time  equation  (5) 
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Nomenclature  for  Chapter  Four  (continued) 


t2 

u 

wi 

w2 


y 


switching  time  equation  (6) 

control  variables  vector  (mxl) 
first  effect  liquid  holdup  (lb) 
second  effect  liquid  holdup  (lb) 

state  variables  vector  (nxl) 
desired  state  variables  vector  (nxl) 

initial  state  variables  vector  (nxl) 

perturbation  variable  (x-steady  state  value) 
output  variable 


A 


X 

Ti 

t2 

Td 


control  variables  coefficient  matrix  in  state 
difference  equation 

=  exp  (At)dt  .  B_  _u(k) 

maximum  deviation 
major  time  constant  (min) 

minor  time  constant  (min) 

time  delay  (min) 

fundamental  matrix  (e^"1") 
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NOMENCLATURE  FOR  CHAPTER  FIVE 


A 

B 

B1 

B2 

C2 

J 

KP 

m 

n 

N 

S 

s 

t 

jj 

wi 

w2 

X 

Z 

4> 

A 


state  variable  coefficient  matrix 
control  variable  coefficient  matrix 
bottoms  flow  from  first  effect 
bottoms  flow  from  second  effect 

product  concentration 

performance  index 
process  ga i n 

number  of  control  variables 

number  of  state  variables 

total  number  of  sampling  instants 

steam  flow  rate 

Laplace  transform  variable 

t  ime 

control  vector 
first  effect  holdup 

second  effect  holdup 

state  vector 

objective  function  in  LP  formulation 

state  variable  coefficient  matrix  in  state 
difference  equation 

control  vector  matrix  in  state  difference  equation 
t ime  eons tan t  . 
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NOMENCLATURE  FOR  CHAPTER  SIX 


J  index  of  performance 

N  number  of  sampling  instants 

t  time 

x  state  vector  (n  x  1) 

u  control  vector  (m  x  1) 

X  maximum  deviation 

Subscr  ipts 

o  initial 

f  final 

k  kth  sampling  instant 


d 


des  i  red 
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APPEND  IX  A 

EQU  I  PM ENT  DESCR  IPT  ION 

A  schematic  diagram  of  the  evaporator  is  shown  in 
Figure  1.  The  unit  operates  at  a  throughput  of  app rox  imat e 1 y 
five  pounds  per  minute  of  three  percent  acqueous  triethylene 
glycol  and  produces  a  product  of  about  ten  percent  glycol. 

The  first  effect  is  a  calendria  type  unit  with  an  eight 
inch  diameter  tube  bundle.  The  second  effect  is  a  long  tube 
vertical  unit  with  three  one  inch  by  five  foot  tubes 
and  is  operated  with  forced  recirculation.  The  second 
effect  is  operated  under  vacuum  and  utilizes  the  vapor  from 
the  first  effect  as  a  heating  medium. 

The  evaporator  has  conventional  electronic  instrumenta¬ 
tion  for  about  fourteen  control  loops  and  the  recording  of 
over  thirty  temperatures.  In-line  ref ractometers  are  used 
for  the  continuous  measurement  of  feed  and  product  concentra- 
tions.  All  transmitters  and  final  control  elements  are 
connected  to  an  IBM  1800  computer.  A  direct  digitial  control 
(DDC)  monitor  system  has  the  capability  of  implementing 
conventional  three  mode  control  as  well  as  other  controller 
configurations.  The  digitial  computer,  which  operates  in 
a  time  sharing  mode,  permits  24  hr/day  unattended  operation 
of  the  evaporator.  It  also  has  the  capability  of  data  stor¬ 
age,  reduction  and  plotting  required  in  computer  control 
studies  such  as  this  work. 
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The  control  loops  of  concern  in  this  work  are  the 
loops  which  control  the  product  concentration  and  the  liquid 
levels.  As  represented  in  Figure  1  these  loops  are  cas¬ 
caded  control  loops.  Normally  the  level  loops  utilize  con¬ 
ventional  proportional  plus  integral  control  with  constants 
which  produce  "averaging"  liquid  level  control.  The  product 
concentration  is  only  run  in  a  closed  loop  configuration 
for  short  periods  of  time  due  to  ref ractometer  drift.  The 
in-line  ref ractometer  which  monitors  the  product  concentration 
must  be  periodically  cleaned.  Accurate  calibration  and 
temperature  compensation  is  essential. 

Implementation  of  optimal  control  techniques  was 
facilitated  by  the  fact  that  the  DDC  monitor  system  has 
provisions  for  a  bias  sum 1  which  proved  to  be  convenient 
for  addition  of  open-loop  optimal  control  action: 

Control  action  =  proportional  +  integral 

+  der  ivat  ive  +  bias 

It  was  necessary  to  sum  the  slave  loops  associated  with  the 
bottom  flow  rates  and  the  steam  since  rapid  manipulated 

variable  response  was  required  in  this  work. 

For  equipment  details  refer  to  Chapter  Four,  references 


[1  ]  and  [2]. 
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APPENDIX  B 

DOCUMENTATION  OF  MODELS  OF  THE 
DOUBLE  EFFECT  EVAPORATOR 

The  double  effect  evaporation  unit  described  in 
Appendix  A  was  modelled  for  control  purposes.  This  Appendix 
documents  the  results  of  the  modelling  and  identification. 

Under  the  assumption  of  perfect  mixing  in  both  effects 
and  of  negligible  response  time  in  tube  walls  and  vapor 
space,  material  and  energy  balances  result  in  six  first  order 
differential  equations.  However,  since  the  pressure  in  the 
second  effect  is  controlled,  the  second  effect  temperature 
is  constant  and  the  second  effect  energy  balance  can  be 
used  to  al gebra  ical 1 y  evaluate  the  overhead  product  flow 
rate.  The  remaining  five  differential  equations  are  listed 
below  along  with  associated  algebraic  equations.  The 
complete  derivation  is  presented  elsewhere*  and  is 
therefore  omitted  from  this  presentation. 

Reference  is  made  to  the  nomenclature  section  of 
Appendix  B  and  to  Figure  1,  Appendix  A.  Tables  1,  2  and 
3  list  nominal  steady  states  and  model  parameters.  Model 
5NL  refers  to  the  five  equation  nonlinear  model  with 
theoretical  estimates  of  the  parameters.  Model  5NLF  is 
the  cor  respond ing  fitted  version  (see  Chapter  Three). 


*See  Chapter  Three  References  [24]  and  [25]- 
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Summary  of  Nonlinear  Evaporator  Model; 

First  Effect 

dw. 

Mass  Balance  =  F  --  0  ^  -  B  ^ 

dc ,  w. 

Component  Balance  — 1  =  FCp  -  B^c^ 

dw,  h . 

Heat  Balance  L  =  Fhc  +  Q,  -  0,H„  -  B,h,  -  HL, 

dt  F  x 1  10,  11  1 


Steam  Chest  =  UAj(Tc  -  T  ^ )  =  S(HS  -  h  ) 

Second  Effect 

dw 

Mass  Balance  =  B -j  -  0^  -  B^ 

dc0w 

Component  Balance  — =  B1c1  -  B0c0 

d  t  ki  cL  cl 


Heat  Balance 


Steam  Chest 


02  =  [Q2  -  HL3  +  B,  [(hT  -  hg) 

dh^  dh^ 

+  (C2  "  cl)]3/th02  ~  h 2  +  ~dc^  C2^ 

Q2  =  UA2(T1  "  V  =  °1(H0]  ~  hcL)  “  HL2 

=  1066.0  +  0.4  T 


Enthalpies  H 
h 


T ( 1  -  0.16C)  -  32 


NOMINAL  STEADY  STATES 
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MODEL  PARAMETERS 
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**  see  Table 


ESTIMATION  OF  MODEL  PARAMETERS 
OF  NONL  INEAR  MODEL 
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HL2  +  HL3  =  heat  loss  for  second 
effect  at  t  =  0. 
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The  nonlinear  model  was  linearized  to  produce 
four  linear  models.  Tables  1  and  2  indicate  the  point  of 
1  i  nea r  i  zat  ion  and  model  parameters  used. 

A  FORTRAN  program,  LINZD,  was  written  to  evaluate 
the  partial  derivatives  required  to  obtain  the  co¬ 
efficients  in  the  linear  model.  The  program  listing 
is  documented  and  bound  separately  from  the  thesis. 

The  following  matrix  differential  equations  are 
the  linearized  evaporator  models  used  in  this  work. 

The  variables  in  these  vector  differential  equations 
are  perturbation  variables  (i.e.  deviation  from  nominal 
steady  state,  see  Tables  1  and  2). 
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B 

C 

F 

h 

H 

HL 

hl, 

HL, 

0 

Q 

S 

T 

UA 

W 


1 


bottom  flow  rate  (lb/min) 

concentration  (wt.  percent) 

feed  rate  (1 b/m in) 

liquid  enthalpy  (Btu/lb) 

vapor  enthalpy  (Btu/lb) 

heat  loss  first  effect  (Btu/min) 

heat  loss  second  effect  steam  chest  (Btu/min) 

heat  loss  second  effect  solution  (Btu/min) 

overhead  rate  (lb/min) 

heat  transfer  (Btu/min) 

steam  rate  (lb/min) 

temperature  (°F) 

overall  heat  transfer  coefficient 
timesarea  (Btu/min°F) 

ho  1 dup  (  1  b) 


Subscript s 


1 

2 

F 

0 

c 


first  effect 
second  effect 
feed 

overhead 


condensate 


APPENDIX  C 


Run  Documentation 

The  following  Tables  summarize  the  data  necessary  to 
duplicate  the  experimental  and/or  simulated  runs  presented 
in  the  preceeding  chapters.  This  data  is  meant  to  supple¬ 
ment  the  Figures  in  which  they  are  used,  therefore  data 
available  from  the  Figures  is  not  reproduced.  A  complete 
compilation  of  all  run  data  including  material  and  energy 
balance  data  is  on  file  with  the  Department  of  Chemical  and 
Petroleum  Engineering.  Errors  of  closure  were  usually  less 
than  f  i ve  percent . 

In  many  of  the  simulations  and  experimental  runs  a 
control  policy  is  derived  from  one  model  and  implemented 
on  a  more  rigorous  model  or  on  the  process.  This  Table 
identifies  models  (Appendix  B) ,  documents  state  variable 
weighting,  state  and  control  constraints  and  other  data 
relevant  to  the  simulation,  dynamic  optimization  or  experi¬ 
mental  run. 

The  abbreviations  used  in  the  Tables  are  defined  at 
the  end  of  the  Appendix.  The  run  numbers  are  those  which 
appear  in  the  run  book.  The  F  igure  numbers  are  those  of 
the  previous  chapters  in  which  the  response  is  plotted. 

The  actual  listings  of  programs^  input  data  and  computer 
output  for  many  simulations  are  included  in  user  documentation 
which  was  bound  separately,. 
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(7)  n  -  20c.  To  =  25.,  t  =  0.0.,  I  =  32  sec.  (8)  Feed  back  of  the  type  depicted  in  Figure 

5-4  (KP  =  0287)  ^ (9)  (10,1, TO, 700) 


S  IMULAT  IONS 


M)  See  Table  1,  Chapter  4;  (2)  See  Chapter  4;  (3)  (10  1  1  10  100)  using  normalized  perturbation  variables 
(4)  Table  5-1;  (5)  FB  of  Figure  5-4;  (6)  Refer  to  Chapter  Five,  equations  (10)  and  (11);  (7)  Xg  limites  on  over  and 
undershoot  at  all  sampling  points  damp  ing)  (  +  5^t  >4^ )  (X  ■> -X  c) -1  im  i  ts  at  all  sampling  points,  see  simulation  output 
for  deta  i  1  s  . 


TABLE  2  ( con t 1 d) 


Abbreviations  used  in  Tables  1  and  2 


P 

01. 

PP 

P  +  i 
t  i  g  h  t 
avg 

T  .0  . 

FB 

SAE 

LLC 

CC 

IP 

F 

CF 

RT 

MRT 


p  roport iona 1 
open  loop 

phase  plane  switiching 
proportional  plus  integral 
tight  setpoint  control 
averaging  control 
t  ime  opt  ima 1 
feedback  compensation 
sum  of  absolute  errors 
liquid  level  control  law 
concentrat  ion  control  law 
objective  function 
feedrate 

feed  concentration 
real  t  ime  switching 
m i n imum  rise  t ime 
set t 1 e  out ime 


control 


3^8 


APPENDICES  FOR  CHAPTER  THREE 

Appendix  1 

Derivation  of  Nonlinear  Gain  Expression 

The  nonlinear  gain  expression  can  be  derived  directly 
from  the  nonlinear  model.  Assuming  a  stationary  state 
exists,  the  differential  equations  of  Appendix  B  become 
algebraic  equations.  In  subsequent  equations 

variables  will  be  represented  as  X  and  X  +  AX  where  X 
represents  the  initial  state  and  AX  the  offset  produced 
from  a  perturbation  in  an  input  variable.  The  input 
perturbation  considered  here  will  be  a  change  in  steam 
flow  rate,  AS.  From  the  energy  balance  around  the  first 
effect  steam  chest  (Appendix  B) 

Qi  =  $(Hs  -  hd  (!) 

and  Tp  are  assumed  to  be  constant  throughtout. 

From  first  effect  mass  balance: 

AB1  =  -  AO  (2) 

Assuming  Tp  is  the  saturation  temperature  and  neglecting 
the  effect  of  small  concentration  and  temperature  changes 
on  enthalpy: 

AS(H$  -  hc)  -  AB1h)  -  AOjK 


0 


(3) 


' 
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or  AO 


FL  -  h 

(jT - -)  as 


0 


(4) 


1  “  nl 


k1  AS 


(5) 


From  the  energy  balance  around  the  second  'effect  steam 
chest 


AQ2  =  A01  Hv 


1 


(.6) 


where  is  the  latent  heat  of  vaporization  for  water  at 


1 


temperature  T  ^  . 

Considering  the  component  balance  around  the  first 
effect : 

F, 

Ci  +  AC 


'F 


1 


B i  +  AB ^ 


(7) 


o  r 


AC 


-C]  AB] 

1  =  ([B,  +  AB ^  ) 


(8) 


AC 


C1  k]  AS 
B  i  -  k1  AS 


(9) 


From  the  mass  balance  around  the  second  effect 


AB, 


AB  i  -  A02 


(10) 


From  the  component  balance  around  the  second  effect: 
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AC, 


B1AC1  +  AB  i  (  C  ^  +  AC  )  -  AB2C2 


b2  +  ab2 


(n) 


or  substituting  for  AB ^  using  equations  (2)  and  (5)  and 
s  imp] i f y i n g : 


AC 


k 1 ( Cp  +  kpCp)  AS 
2  =  B"  -  k7(  1  +  k2) AS 


(12) 


where 


k. 


\  -  (A  -  A) 


H 


V, 


(13) 


Evaluating  the  linearized  equivalent  to  (9)  and  (12) 


i  e . : 


K 


L ,  AS 


d  1k] AS 


B1  +  k ^  AS  ' 


AS  =0 


K 


L 


im i 1 ar 1 y 


klCl 


B 


1 


k,(l  +  k  ) C 


2 '  2 


B, 


(14) 


(15) 


Substituting  (14)  and  (15)  into  (9)  and  (13) 

K, 


AC 


1 


1 


AS 


1  -  KL1  AS/C-j 


(16) 
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K 


L 


2 


(17) 


AS 


K 


L 


AS/C 


2 


2 


AC 


2 


AC 


AS 


(18) 


Equation  (17)  is  useful  in  predicting  the  gain  for 
open-loop  simulations  of  the  process  to  step  changes  in 
steam  rate.  However,  in  the  servomechanism  problem  when 


the  change  in  C^  is  known,  AC^,  a  more  useful  form  of  the 
gain  equation  is  equation  (18). 


Figure  1  indicates  the  performance  obtained  from  this 
nonlinear  gain  expression.  Experimental  data  for  the 
steady  state  gain  are  very  scattered  when  raw  data  is  used. 
Adjusted  values  of  the  product  concentration,  the  symbols 
in  Figure  1,  yield  better  results. 


, 

I 
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FIGURE  1:  Comparison  of  Steady  State  Gain 

5L;  -  5N L , - gain  expression 

A  exper iraenta 1 . 
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